You are conflating morality with proper governance. Democratic government must enact the will of the citizen body, even if immoral in some frameworks.
I think this distinction would help as well.
Inhumane != human rights violation.
Both of these things can be true at the same time: 1. It can be inhumane to halt someone's visa application
2. Visa applicants have no human right to have their application processed
One side hammers the first point because they disagree with the government. The other side hammers the second point because they agree with the government.Everyone is right, except for the implication that their point disproves the other side's point.