Hacker News Reader

Comment by littlestymaar | Hacker News Reader

This is something that's obvious to anyone playing with local LLMs but that doesn't seem to be that much well-known even among tech enthusiast.

Qwen is really ahead of the pack right now when it comes to weight-available models.

View on HN

How does it compare to Claude?

nothing compares to claude, not even gpt-4.

Claude is the best at coding but the limits are the problem. You only get like a handful of messages.

With free or with paid too?

You can pay for Claude API access (not normal Claude Pro) and wire in something like Cline via your API key, but it gets expensive fast in my experience.

which size are you using?

I don't see why you would use it over claude and 4o-mini with cursor unless you are working on a top secret repo

the company i work for and actually most Swiss IT contractors have harsh rules, and more than half of our projects, we aren't allowed to use Github Copilot or pasting stuff to any LLM API.

For that matter I built a vLLM based local GPU machine for our dev squads as a trial. Currently using a 4070Ti Super with 16GB Vram and upgrading to 4x 4070Ti Super to support 70b models.

The difficulties we face IMHO:

- Cursor doesn't support WSL Devcontainers

- Small Tab-Complete models are more important, and there's less going on for those

- There's a huge gap between 7-14b and 120b models, not a lot of 70b models available

In reality, on 7-14b nothing beats Qwen2.5 for interactive coding and something around 2b for tab-completion

> - Cursor doesn't support WSL Devcontainers

If it works for you, devcontainers now work under Linux w/ docker.

> I don't see why you would use it over claude and 4o-mini with cursor unless you are working on a top secret repo

Plenty of companies won't let you use those products with our internal code.

Reply on news.ycombinator.com