I think it's the foreign aspect, but also another one is that when you have limited experience of what a casual Christian (or Buddhist) is like, it creates a falsely positive impression. Many of the Christians people in this country would be familiar with are a mixture of missionaries and people who came and did things like set up schools and hospitals for people at little to no cost. And, vice versa, Buddhists Americans are generally familiar with are going to be those genuinely interested in the pursuit for its own sake, rather than driven to such out of cultural inertia.
By contrast here you get daily news about things such as monks being busted running illegal gambling dens, and sometimes the rather more perverse. And there's also a culture associating various Buddhist icons with good luck which trends towards a complete bastardization and mockery of it as people try to literally use such for good luck. Think of something like the equivalent of a poker player praying to God 'Just one time, Jesus' while rubbing a crucifix. The various Buddhist "rituals" for good results during finals are well, not something that's going to exactly exemplify the moral pursuits of Buddhism.
Seeing people express something along the lines of the myth of the noble savage, when you're that savage and certainly not noble is quite interesting, and jading!
lots of rich religious folks out there in history. when they expropriated the buddhists in the huichang expropriation during the tang, they took tens of millions of acres of arable land and liberated 150,000 temple slaves
Do you happen to have any good links for learning more about this?
The Wikipedia page[0] is a mess and my Google skills have fallen short.
[0]: https://en.wikipedia.org/wiki/Huichang_Persecution_of_Buddhi...