This sure sounds like an interesting problem. With the likes of AI, Google's Cloud Vision[0] and hopefully many more this sort of thing can definitely become a reality in the near future.
I've had several interviews with folks who are edit/sort a large amount of photos, and there are a lot of needs in that space. A really flexible image categorizer would help a lot of people.
Pulling numbers off a uniform (typically high contrast) is not very complex.