it really depends on the situation for me. If the waiter/waitress asks politely and if I am to change from big table to small table for a group of more people, I would do it. This is why sometimes I rather wait for longer instead of joining others in a big table.
I think moving from big table to small table is fine but what if the waiter / waitress asks you politely to change table and share big tables with others?