What are the limits to this right?
Let's say you have a right to travel down a road with a bridge on it. Then 1000 people decide to travel across it at once and it collapses. Obviously each individual doing their own thing isn't a problem, but when a lot of people do that thing it becomes a problem.
We all love the idea of freedom, but it always requires responsibility. When individuals do not take this responsibility then issues like the tragedy of the commons manifest.