Depends on context though.

An LLM is useless (or not as useful) in OCR for forms where we are trying to extract the name "John Smith" from a name field whereas a HMM trained specifically on name fields may be able to do a better job.

LLMs may perform better as a post processing step for running text (such as book pages).