Yes because those causes usually dont affect others. With COVID, those unvaccinated people create a breeding ground for new even stronger variants of COVID that could kill millions more. Or force us to go back to quarantine even longer. If you are hell bent on risking your own life, fine, but your liberty ends where mine begins.
These kind of hyper libertarian arguments always just conveniently ignore everyone except the person making them. We allow smoking because it's your choice but not in public places because that hurts others. We have speed limits because your liberty to drive at 120 ends when it endangers other drivers. We have no restrictions on how much fast food you can eat because it does not impact anyone else.