I recently started using paperless-ng, check it out, perhaps you can build on that. Includes tessarect for ocr for example.