I'm pretty sure that exit tax is for citizens only. They'll have a hard time tracking down non-citizens and no leverage, except for threatening to revoke the green card and/or restrict entry into the US.

The marriage thing is a very good point.