Yes, it is an assumption. Unfortunately, this situation is unprecedented, so everything we do has to be an educated guess. I would also note that you followed it up with an assumption of your own ;)
It is well established that physical distancing limits the spread of virus transmitted via respiratory droplets. If you refute that, I would require significant peer-reviewed literature on your side. https://academic.oup.com/jid/advance-article/doi/10.1093/inf...
It is also irrefutable that contracting COVID-19 carries risk - especially for high-risk individuals with comorbidities (yes, even young people)
Combined, I don't see how you can come up with a hypothesis where getting people together would somehow be equally as safe as keeping people apart.
Again, this is just one aspect that policy makers have to consider. There is also the economy, mental health, etc. I think having those discussions is very interesting - how much should we protect our health vs our way of life? There are very valid arguments against continuing the shut-down.
But acknowledging that social practices directly impact virus transmission is a necessary step to have meaningful discussion.