Google Goggles can already solve Sudoku using OCR--http://www.newscientist.com/blogs/shortsharpscience/2011/01/...

So what you are suggesting isn't that far fetched.