I think it’s about the approach. “Questioning someone’s competence” has an air of trying to be underhanded. Be direct, set clear expectations. And if you have to let them go do it promptly and professionally.

No one likes getting fired, but if you’re not right for the position it’s not psychologically safe to let you flounder.