I did my PhD in Multiperspective imaging (if that can be considered a field :) and I remember some guys from Stanford did some work specifically on these kind of street views. Here's a link to an overview at least http://graphics.stanford.edu/~ggaurav/research.html

I think that guy in particular might have ended up at Google, it must be a bit painful to see Microsoft release a demo of this stuff.