You can already do this with smaller LLMs, like 10B range. The computer vision/image interpretation has been sufficient at this magnitude for a few months now.
Can run on most decently powered consumer devices.
Latency not great vs ad block though, of course.
Perhaps a fine tuned model explicit to this purpose could be even more compact.