Experienced servers will usually try to 'feel out' a table to understand if they are in a rush, demanding, want to converse, etc. The same behavior that feels rude when you're catching up with old friends is often welcomed by a table that might have limited time to eat or that prefer to have things done without waiting or flagging someone down.

You do realize that it's perfectly acceptable and commonplace to explain your group's preferences to the server upon first being introduced? You're really telling them exactly what would make you happiest while also reducing the effort they need to spend on your group, a mutually beneficial setup.

Of course, incentives may not align in certain scenarios. On a busy night/time or at restaurants that don't have lots of seating, having a table that they can't 'turn over' quickly may be undesirable, especially if purchases (another round of drinks) aren't being made occasionally.