I don't see how people being different from one another (uncontroversial, obvious basic fact) means that people have fundamentally different phenomenal experiences. You're conflating ability with experience when they are not the same thing.
https://calteches.library.caltech.edu/3591/1/Feynman.pdf
worth a read, to me it kinda indicates that different abilities can be enabled by differences in how to mentally represent something. but yeah its debatable how much of difference in ability comes from/with a difference in experience but I my gut feeling is a lot more than you'd think. feels really hard to prove it as we only know what it's like to be us.
Either way, you've established a difference in subjective phenomenology and there are people on either side of that divide.