The less the reader arm has to move the faster seeking should be.
So if you place the swap near the rest of the files the hdd arm will not need to move so much.
Given that this was pretty much a clean Linux install I would assume that most files where at the start of the disk close to the best swap location.