On my Windows machine, I switched to Chrome from Firefox years ago largely due to better (perceived) performance. I switched back to Firefox this year and haven't noticed any slowdown as a result.

Firefox does seem slower than Safari on OS X, but I don't use Chrome enough on my Mac to compare Firefox vs. Chrome.