Meta releases an open-weights GPT-4-level AI model, Llama 3.1 405B

Pleasantly surprised to find it available as an Azure service already so there is some hope of using it on private data without buying any hardware. Does anyone have experience with their "AI Studio Hub" ?

https://learn.microsoft.com/en-us/azure/ai-studio/how-to/dep...

"It's potentially the first time anyone can download a GPT-4-class large language model (LLM) for free and run it on their own hardware. You'll still need some beefy hardware: Meta says it can run on a "single server node," which isn't desktop PC-grade equipment. But it's a provocative shot across the bow of "closed" AI model vendors such as OpenAI and Anthropic."

I love that Ars-Technica calls out BS on the title of the article: "Open source AI is the path forward," says Mark Zuckerberg, misusing the term.

The author Edwards states correctly "...undermining your competitors using a model subsidized by a social media war chest is also an efficient way to play spoiler in a market where you might not always win with the most cutting-edge tech."

[dupe]

More discussion: https://news.ycombinator.com/item?id=41046540

https://news.ycombinator.com/item?id=41046773