In the text you shared, you imply that other readers should come to the conclusion that he's a racist because he's against public transit due to fear of crime being imported. But you made no connections as to how his claims of crime import were related to a race component. So it's understandable that readers might not find your "racist" labeling justified based on the facts that you shared.

He might be a racist but based on what you said, it's not clear what may make him so.