Not just the South, but China too. North Korean refugees are already a concern for China.[1] If the economy or the government collapses in North Korea, it's not hard to imagine chaos spilling over in to both countries.

[1] http://blogs.piie.com/nk/?p=13422