Does Cerebras support reliable structured output like the recent OpenAI 4o?
Does Cerebras support reliable structured output like the recent OpenAI 4o?
For example, I know the latest batch of Mistral models all have json output support.
Cerebras is a startup producing innovative AI chips. Their chips are super cool, and I personally believe Cerebras is ahead of the industry and is on the right technical path. As a matter of fact, Cerebras started with HPC chips. Then pivoted to AI like everyone else.
They are still deep in the trench for survival.
Given that, they have very little software prowess compared to AMD (which has *terrible* software stack for AI GPUs look at https://github.com/ROCm/rdc, an equivalent to NVIDIA DCGM, which virtually has no maintainer, and no one is using it), NVIDIA (the golden standard of software stack for AI GPUs); and you are referring to structured output and prompt caching which are prominently developed by LLM research institutions (OpenAI Anthropic, each of which have way more funding than Cerebras)
In the end, educate yourself, and do not put unrealistic expectation on startups.
The point remain that Cerebras is not in a position to focus on structured output or prompt caching.