You don't lose taste, you lose your appetite, which means you can resist the temptation to eat easily, and you feel full very quickly. That doesn't prevent you from eating what you like, but it does help you to not eat too much of it, which I hope is not what you mean by "more freely".
The appetite comes back when you cut the meds, but it's an appetite based on your new weight. But if you then go on a some suggar rampage, you will regain weight and your appetite will grow too.
Those drugs are merely a guard rail to complete a diet successfully, but if people do not change their eating habbits, the same causes will produce the same effects after they cut the meds.