Exactly. Which is why, when there is an epidemic of a dangerous disease, measures need to be implemented that assume that everybody is infectious unless proven otherwise.
Mature democracies should have the ability to carefully and responsibly limit some rights in times of great crisis, such as wars and pandemics.