Well, if we want to have a society, we should very much define "freedom for others" too, considering the whole tradeoffs and issues or benefits of a practice (that's how we decided to have laws and ethics and other stuff, of course).
Not just leave it at "anything goes", and let everybody else get the consequences of individual choices, even if it's not their choice or to the detriment of the society at large (like, destroying public health or the environment).