Hacker News Reader

Comment by shmatt | Hacker News Reader

I work at a big tech company and there is a complete ban on coding using LLMs. The fear is sending our code for the model to learn in the future. This is also why then hype around GTP4-powered Office is overhyped. Very rarely will a corporation be OK with GPT-4 running inferences on their internal documents and excel sheets

Until an on-prem solution is offered, many of these companies won't get anything out of the technology

The layoffs at big tech are caused by un-even profit generating, Where 5% or 20% of the company generate 99.9% of income. The rest are essentially startups being funded by rich VCs. Eventually if you don't find PMF the VC cuts the funding

View on HN

> Very rarely will a corporation be OK with GPT-4 running inferences on their internal documents and excel sheets.

Which is why Microsoft will be able to charge outrageous fees for enterprise plans that keep employees' queries to GPT private and out of future training sets. I do not think on prem will be successful, though, the hardware requirements are fairly substantial and specialized.

How do you reconcile what you just said with the massive popularity of cloud services? The source code is already sitting in the same data center the LLM GPUs are sitting in.

Of course there are some businesses too paranoid to use the cloud, but even intelligence agencies are on board these days.

Probably because people view the cloud as their data in someone else's hands, but AI companies view data as fair game for ingestion, since "they just learn like humans, and you allow humans to view your data, right?".

With cloud services, there's some expectation that your stuff is private. Copilot is like doing all your cloud development with an anonymous FTP server.

> Very rarely will a corporation be OK with GPT-4 running inferences on their internal documents and excel sheets

Aren't they already doing this, if your documents are in Sharepoint or Google Drive? I have assumed so, but with no basis

For big companies, that on-prem solution is coming sooner rather than later. For small companies, plenty of them (likely the large majority) will be very willing to take the "risk" for the save in labour costs.

Reply on news.ycombinator.com