I like the idea, and it works. Here's two constructive concerns:

1. Can you make this faster to type than a browser extension that searches from the address bar (or in Chrome's case, omnibox)?

2. How do you account for false positives, like a picture that doesn't match the word?