It's also very difficult to justify under the commerce clause I imagine.

That said, the US constitution is an interesting beast, because of the Supreme Court's very very progressive interpretation of the commerce clause.

The Supreme Court has a very large amount of discretion in these things.

There was also a rather creative argument based on the Third Amendment (quartering of troops), assuming at least some of the tenants were soldiers.