I actually don't like this attitude. In every case it's a mostly a matter of interest and effort. If you have those you can learn something.
Mind you it's different with for example fluid dynamics or functional programming or even chemistry or biology, I have zero knowledge of it (nor interest) and all I know is that it's hard... but I know that if I spend years learning it I will succeed. I don't know how to explain this feeling I have with music - it's just foreign on another level
In some cases, perhaps even most, this is due to an aggressive indifference to learning something new, but maybe it is not always the case that this is the explanation? It could be that the mechanism for understanding this one particular matter is genuinely missing or undeveloped in that person's brain.