So they would stay in Hungary instead which already has more refugees per capita than Germany and is totally overwhelmed? Or in Greece which is in the middle of a crisis itself? How about Lebanon and Turkey where there are more than 10 times as much refugees, where refugees have no perspective of being able to work and where basic needs of life are not guaranteed.

Free speech is about the right to express oneself, it has nothing to with people not being allowed to disagree with you.