> This is the whole 'eminent domain' debate in a nutshell.

Not quite--eminent domain is also used to take property from people who ARE using it. And I think that is where that debate gets very thorny, because the compensation is not always worth the costs of uprooting someone from their home.