Although the outdoor swimming facilities are amazing, the swimming pools used for sports swimming are still few, small and generally overcrowded.
Which is to say anywhere pools are the primary place people swim, they will be few, small, and generally overcrowded (and also expensive). If you live where there are natural places to swim you will generally find it better, but many places don't give you those options.