Who says that's what "free" means? Why should we be free only from physical harm and not emotional harm? You can't claim an ideology is self-evident when it rests on arbitrary definitions of terms.
Besides, your definition is flawed. Does sexual assault count as a physical or an emotional harm, if it causes no physical injuries? There are many forms of sexual assault which cause exclusively emotional trauma. Are we not entitled to be "free" from these?
Meta comment: people like you can argue on the basis of abstractions because clearly that's all you have to argue from – you obviously have no experience of child abuse. And I'm glad of that, but please be careful putting about your opinions ("...no law against socially excluding and humiliating people. Nor should there be.") with Dunning-Kruger boosted confidence.