We regularly restrict choices of vulnerable people in our society. That’s why kids can’t drive, drink, smoke, etc.
Driving involves danger to other. We restrict adults from doing things that are a danger to others, it has nothing to do with being "vulnerable."
It might not be a perfect implementation but it will prevent a lot of the real world harm that people are seeing.