Pardon me if this is stating the obvious, but the captcha images being decoded serve a second purpose. In short, Goggle is crowdsourcing the decoding of those images in a mechanical Turk sorta way.

Why street signs and house numbers? Because when your taken as much Street level photos as they have some are gonna need human review.