Why not use Firefox multi account containers[1] for this use case?
Having one banking container or even one per bank would have the same effect, without the annoyances of private mode?
[1] https://addons.mozilla.org/en-US/firefox/addon/multi-account...