Maybe I don't understand exactly what you are saying, but if I do: there is a fundamental difference between Gypsies and homeless people, you are born a gypsy by no fault of your own, but most people are not born homeless. As such racism towards Gypsies is far more heinous because you could have any education, profession, income, housing situation you'll always stay a Gypsy and face the same prejudice, whereas you can (somewhat) more easily stop being homeless.

Now we could have a discussion on whether being poor is a choice or a consequence of societal inequality, but I think more people agree on racism here...