The Swiss ruling class don’t have as much disdain for their populace. It will only end up that way if the Swiss people will it.
A lot of the UK’s problems were a result of the EU being vindictive as well. The EU won’t act vindictively because they aren’t in the EU.