Right, and my point is that you essentially can't. For my address the best you could do is narrow it down to ~30 or so homes that share the same first digit as my address. For this to work you have to:

(1) Have the IP address return the right location

(2) Not have duplicate street names in that location

(3) Have a single digit address OR be the only home starting with that number

That's going to be a pretty rare combo. Probably less than 1%.