Hacker News Reader

Comment by azinman2 | Hacker News Reader

News update: OCR company touts new benchmark that shows its own products are the most performant.

I searched for any link between OmniAI and Alibaba's Qwen, but I can't find any link. Do you know anything I don't know?

All of these models are open source (I think?). They could presumably build their work on any of these options. It behooves them to pick well. And establish some authority along the way.

The model with the best accuracy in the linked benchmark is "OmniAI" (OP's company) which looks like a paid model, not open source [1].

[1]: https://getomni.ai/pricing

Someone should try to reproduce and post it here. I can't, my PC is about 15 years old. :(

(It is not a joke.)

Reproducing the whole benchmark would be expensive, OmniAi starts at $250/month.

Generally running the whole benchmark is ~$200, since all the providers cost money. But if anyone wants to specifically benchmark Omni just drop us a note and we'll make the credits available.

So not all of them are local and open source? Ugh.

I don't see why you couldn't run any of those locally if you buy the right hardware?

I haven't checked myself, so I'm not sure, others might be able to provide the answer though.

If they (all of the mentioned ones) are open source and can be ran locally, then most likely, yes.

From what I remember, they are all local and open source, so the answer is yes, if I am correct.

Mistral ocr is closed source

Thanks!

To be fair, they didn't include themselves at all in the graph.

They did. It’s in the #1 spot

Update: looks like the removed themselves from the graph since I saw it earlier today!

Yup, they did.

The beauty of version control: https://github.com/getomni-ai/benchmark/commit/0544e2a439423...

Reply on news.ycombinator.com