It's more then just that with heroku's random routing.

If you are on shared tenancy dynos, and your current configuration is nearing maximum capacity, then adding dynos can reduce performance. Not per dyno, but across the entire platform.

Counter-intuitive but true.