>After I scanned a wide variety of puzzles from each book, my server had stored about 600,000 images
600,000?!? Even divided by 81 that's over 7000! How long did this take?
600,000?!? Even divided by 81 that's over 7000! How long did this take?
I just hacked into my app's flow to upload a "scan" of the isolated puzzle to my server instead of slicing it and sending the component images to CoreML.
Then I sat there and flipped through page after page of Sudoku puzzles and scanned them from a few different angles each, sliced them in bulk on the server, and voila: data!
The app already had the code for "isolate the puzzle and do perspective correction" so the uploaded images all looked something like this: https://magicsudoku.com/example-uploaded-image.png
By "slicing in bulk" I mean the server was the one that split that out into 81 smaller images rather than the app doing the slicing and uploading 81 small images.
Taking them from different angles was done because the perspective correction adds distortions that I didn't want my model to be sensitive to.
Props for doing the project end2end, including the non-trivial (and typically skipped) part of collecting training data.