Hacker News Reader

Comment by ilc | Hacker News Reader

Honestly, with a 3090 costing like $700 used. It is within reach of many on this site quite easily, assuming they have a machine to plug the 3090 into.

People seem to think the hardware for this stuff is way out there... it is getting to be within reach VERY quickly.

View on HN

Yes, but if you're looking for code completion at the quality level of Codex/Github Copilot, that's still a bit off.

Don't fall into the trap of: It has to be the best or it is useless.

The question for me is: Does it help me get my job done. Does it assist me in ways I find useful.

I have been using github copilot for a while now, but when I first tested these, together with the code AI offering from Amazon, they were... kinda useless. Only after a few updates did it get to a point that was a net positive in my daily work. And I still occasionally check the local models, and they're still not on a level in their auto-complete capabilities that I'd like to use, at least last time I checked. But I work with other LLMs and the recent advances in speed and the stricter nature of code means that soon-ish we should have a good and fast local model, we're just not there yet.

I don't use them for auto-complete that may be the difference. I use them for various other things. Tests, etc. I don't find them 100% accurate. But it beats writing it from scratch.

Okay so maybe 5% of developers who use desktop will be willing to fork out on a GPU and go thru process of setting up something that costs $10 otherwise...

Can you show me the metrics for that, please.

Additionally, what's your company's IP policy? Do they let you send their code to a remote company or do they see that as a breach of security?

I'm sure there are all sort of companies with very strict isolation requirements. But your typical enterprise will run your code editor in cloud VDI, host on atlassian, deploy using atlassian, deploy on some other cloud provider and be developed by double outsourced junior developer who's got warezd windows licence. I fail to see how adding another party who says they explicitly don't collect your data will make any difference.

Reply on news.ycombinator.com