It's not psychological. It's time. If you're taking the bus to work and/or working more than one job, you on average can't spare the time (and energy) for training and events. Furthermore, there's the cost of the gear, event entry fees, etc.
The fact that rich (white) people spin the issue as "psychology" is simply another example of their disconnect.
Sad. But true.