Your answer lies in the distinction between cults and religion. In a nutshell, cults exert control over their members such that they compel them to behave contrary to their own interests.
So the modern, practical answer to that question is: No.
Your average Catholic is no threat and is very likely to be acting in their own interest, free of undue influence.
The Catholic Church, having had nearly two thousand years to brutally weave itself into society world-wide—has all but abandoned the behavior described above—with the exception of its clergy and people involved at the operational level of the church.
Indeed, they've outgrown the practice of using coercion at the level of the individual member, and now wield power as a small nation state with global reach.
>Should we forbid Catholics for the same reason?
If they're formerly or currently involved in any significant way at the operational level of the Church, then you may have an argument in the affirmative there. Albeit, a narrowly-scoped one.