You're fighting a strawman; no one has made any comments to this being "a phobia worth pathologizing".
As far as I can tell, folks are just commenting on how this affects their demographics and ability to scale social services in the coming decades as their tax base shrinks. That's a real problem.
I don't see how you read any other intent.