Yep, 200K sounds a bit too many: Statistics Norway shows under 70K Scandinavians (not just Swedes) as of 01/01/11
http://ssb.no/emner/02/01/10/innvbef/tab-2011-04-28-08.html
You probably have to add some commuters, but they will hardly change the big picture.