There is another plausible explanation: there are many people, especially photographers, near the turn for lanes 1-4 but none for 5-8. The start has people on both sides. The rest of the deck is barren. Even after 15 years of competitive swimming, the visual presence of yelling people still had impact on my effort level, while the presence of a stroke & turn judge leads to a tightening of form (ie less dolphin kick in breaststroke).
Edit: of course, this could still be unfair but at least it would be due to human psyche rather than currents