Very insightful point.
The biggest salary negotiation mistake I see is when people assume the negotiation is of the first type (one-off, never see people again) instead of the latter type (part of an ongoing relationship).
If a company works hard to minimize someone's compensation expectations and convince them to accept below-market salary, they're going to pay for it later when the person wises up and leaves for something better. This scenario is well-known.
The less discussed scenario is when a candidate aggressively negotiates a very above-average compensation but subsequently performs in a below-average manner. This is one of the most common complaint scenarios in a private manager forum that I'm part of: Managers who get wowed by people with excellent interviewing and self-selling skills who end up underperforming their lesser-paid peers later. It generates a lot of guilt and anxiety for managers when they realize they've been duped into inverting the contribution:reward relationship in their compensation structure.
These people are the first to go in any downsizing, reorgs, and layoffs (and rightly so), but they're often great at talking their way into the next highly paid job almost immediately. This is one of the main reasons experienced managers will go extra deep on reference checks for people with job-hopper resumes.