Why ought we to ban the others? That you're okay banning certain activities is no justification for stopping those who want to do them.
(2) People not actually wanting to do them sometimes is a good reason too (e.g. free market forces, addiction, peer pressure)
China after the opium wars is a good example of how this can play out.