>Why would that matter?

The game devs are going to spend all their time & effort targetting amd/nvidia. Custom code paths etc.

It's not a one size fits all world. OpenCL etc abstraction are good at covering up differences, but not that good. So if you're the player with <10% market share you're going to have an uphill battle to just be on par.