One thing that's always bugged me about Georgism, or property taxes in general, is that you can't be self sufficient and it makes colonization mandatory.
There's still plenty of parts of the world where people live off the land, and under Georgism, those people would need to be taxed. Imagine arresting all of the inhabitants of North Sentinel Island, because they occupy land but don't pay taxes on it.