Yes, this the gist of this proposal by the ethno-nationalist right. That is what it says in the linked article above, did you read it? If you did, why do you ask more? If not, how is it that you care enough to ask?
if they really want to deport regular integrated members of society who only differ for their color then I probably wouldn't agree with that policy of theirs if I was Swedish.
The linked article above is literally Wikipedia. You are wasting everyone's time.