I recently saw a post on Mastodon where someone figured out they could build a simple Automation[1] on their iPhone to assist them in avoiding foods that contain allergies. They take a picture of the label, then the automation OCRs the text and searches for $ALLERGEN.

It seems the technology for making "screenshot APIs" a less zany proposition is emerging.

[1]: https://support.apple.com/guide/iphone/create-an-automation-...