Ask HN: Would your company benefit from local LLM development?

1 pointpyramidihuijari2 comments

Meaning, all the data stays within your company infrastructure, and you own the model, eliminating the need to rely on third-party APIs?

View on HN

Yes, our company would benefit from that. We deal with large swathes of legal documents and construction plans and automatic verification, validation, and categorization would be useful. Our own efforts are concentrated on ML-based object detection and identification, which is more important to us than above mentioned functions.

We are not large enough to do both, but German enough to not consider outsourcing this to a cloud service ;)

At https://mapleintel.ca I am using Phi4 locally.

It's nearly certain if I used one of the saas options I'd get better results, but at what cost? And really how much better?

Reply on news.ycombinator.com