It's not likely that a computer vision system is going to be that much better than humans at the task. Maybe it will be able to guess your latitude by the color of the sky or something crazy like that, but not give you an exact address.
Automatically match iconic buildings to those in a database.
Have a list of features that are different from nation to nation, or region to region, and match them. Electrical outlets, road signs, road markings, fire hydrant colors, and match them automatically.
Have a list of different geology. Light coloured rock in this region, reddish soil in that region, very flat terrain, very undulating terrain.
This is what comes to mind in one minute of thought. None of these would be effective on their own, but combined you could probably get surprisingly close.