I don't play GTA and I was able to get a decent score by just correlating the visual features with the outline of the map + prior visual references from previous rounds.

Someone should create an arbitrary environment generator and render the 3D image + map outline. I could totally see a variant of GeoGuesser for unknown worlds. That would be trippy.