Wow, speed is great. I'll definitely check it out. However, the second statement still seems to be valid: OSM is still at the street name level rather than street number level.
I read some MapQuest's document saying that Mapquest actually took points on a street and interpolate all the numbers. Maybe OSM can do the same. Eagerly waiting...