The downside is that they make you eat less thereby taking away one of the few things that make life worth living.
If you're tired and don't have energy you'll also feel depressed but that doesn't automatically mean you feel tired solely because of depression.