I'm not so sure about that. Gossiping and commenting also has the potential to form shared opinions and values within the group that attends the meeting, not to mention a certain group-think. There is a possibility that these values diverge from what would result from public discourse.
I would hypothesize that the mere fact of being invited to a traditionally secret club tends to make people more selfish, arrogant, and prone to abuse their power. I don't know this for a fact, but other results of psychological studies that I have heard of make it seem very plausible.
This is especially important with politicians. Politicians are supposed to be servants of the people. If we take psychological studies that point to a "fake it until you become it"-effect seriously, we should demand of politicians to also behave and carry themselves like servants. The Bilderberger group is a venue (admittedly, one of many) where politicians can become detached from their duties.
So like I said, it's less flashy than a Hollywood-movie conspiracy, but important nonetheless.