Really cool idea, I think people would love that! The biggest hurdle would be getting enough interesting content. You would almost need to create a Wikipedia for real world locations.
If you were able to get enough content I think that would be an incredible app/service.