Possible ending of free movement of people? Possible emigration of the finance industry because of that and because of loss of institutional "passporting"?

There's plenty of evidence, the finance industry has been sounding loud alarms for some time.

But the very fact that you ask is an evidence that people are deliberately deaf to them. So, the best answer I can give you is "wait and you'll see".