Ask HN: Self-hosting LLMs, is it worth the setup?

1 pointsb132 comments

With the advent of DeepSeek, I was thinking if I should consider self-hosting open source LLMs vs using OpenAI APIs. Who here has done this already? And what are your main reasons, privacy or cost?

View on HN

people have been doing this for a while now? cost is one factor obviously, but privacy, security, and offline use comes to mind.

I was thinking more about them in my cloud environment. Was it easy to setup and maintain for you?

Reply on news.ycombinator.com