It only does that if you click the app icon on the dock or use Alt-Tab to switch apps. If you just click a window it does not bring all of the other windows from that app to the front.
I can't reproduce this behavior so maybe it's changed in recent versions.