There is a slippery slope here: If taking moderately effective drugs with no side effects becomes commonplace, there will be pressure to take more effective drugs with slight side effects, then possibly very effective drugs with considerable side effects. Just like in sports.
In my opinion, this is not something to be afraid of, but something to be aware of, and debated.