My poorly made point being: executives have been driven insane by AI/ML hype.
I sat through a two day (all day) "retreat" (conference room in our regular office) where people tripped over themselves to present their teams innovative AI ideas to leadership.
"It's a chat bot that..." "It's a chat bot that..." "It's a chat bot that..."
I just wanna make pretty graphics go fast. I don't need to turn everything into a cloud based app with an LLM attached to it.
This is partly because it needs to output reliable well-structured data for downstream integrations.
Do any of you even use the stuff you complain about?
At least if they either use the user's code in training OR if it uses any code with unknown provenance.
Microsoft's solution seems to be the best: we take responsibility for the code. But that responsibility comes at a cost.
And, if you want AI but only using local models, all the same UI API’s are available to you. (modulo some know-how)
There are also many other cases where it is just outright prohibited, or heavily restricted, even if the aspects you describe were allowed.
Compliance-related challenges due to potentially biased decision making.
Financial regulation compliance concerns.
Government regulations around the application of AI/ML in certain circumstances, or model use restrictions.
JetBrains makes it clear that the code is not submitted for training purposes, contrary to the speculation in a lot of comments.
It’s also not enabled by default and requires a trial or subscription as well, so it’s not something people are going to stumble into accidentally using.
I’m sure some strict companies will forbid the use of any product that might possibly have an AI component, but they’ll be refining policies and making exceptions as everything from operating systems to web browsers start coming with optional AI features.
The llm should have been offline
People are now in the phase of “if there’s no AI we’ll die” of their products so we should expect it will get much worse before it gets better. I’m now mostly turned off whenever I see a company saying they’re adding “more AI” to their products as that usually means the experience is about to get worse.
You can’t just throw AI into your existing product and hope that it will fly. Even the most impressive implementations will hit the hard wall of money. Adding AI to an existing product is far from free and you’ll probably need to upgrade your Pricing pages if you add AI to your core offer.
Heck, even OpenAI is currently having a hard time making ChatGPT+ profitable even though they are pricing it at $25 a month. So imagine all those companies hoping they could easily add "ChatGPT" to their $9.99/m business.
I think there is a reason we still don’t see Siri or Alexa powered by GPT while everyone is hoping it’ll happen : Siri & Alexa have always been designed to be cheap and they still dont know how they will sell you the $30/month Alexa Prime.
If they made a profit right now, all investors would hit the ceiling and tell them to stop doing such insane things. In the current stage they're supposed to grow and take over the market (and build a "platform"), not make profits...