Hacker News Reader

Comment by sajithdilshan | Hacker News Reader

If you've built a product based on AI, then diversify or make an abstraction layer so your product is model agnostic and you can plug and play any model. If you're an end user like a software engineer, just use another model or like Gemini or ChatGPT. That is more productive than complaining about a trust which wasn't there in the first place to begin with.

Anthropic provides a service and they can stop offering it regardless of export ban or not, same goes for any other AI company in any country. If you really wants a trusted LLM, then run your own open weight model.

View on HN

you cannot plug and play random models. they are all different trained on different data and rl for different capabilities.

They didn't say "random models". The mentioned other models that are trained for the same purpose with close to the same capabilities.

Anthropic's best models are very good, maybe the best in their category. But, they have direct competition. You can, in fact, just switch to Codex or Gemini or GLM. It mostly is plug and play. I have a preference but I also have options.

> The mentioned other models that are trained for the same purpose with close to the same capabilities.

well they dont tell you that do they? there is no way to tell what model can and cannot do unless you extensivevly test it yourself and pray for the best.

If you don’t have a proper testing mechanism for your product, regardless of the model, you shouldn’t be shipping it. Praying for the best is not a strategy and don’t blame your lack of testing strategy on the LLM capability mismatch

even anthropic uses 'user reports' in alignment system card.

Do they lack "testing strategy" to test their own alignment?

Can you share the you testing strategies that are letting you plug and play models.

OpenRouter would like a word. Also my in progress SaaS would like a word. Models are incredibly interchangable, just find best performance per cost and optimize harness and prompts, easy to have multiple configs for each model.

Reply on news.ycombinator.com