Im not sure if anyone cares about my opinion, but I think its worth mentioning that of all the models, Mixtral is IMO the best, and I do not know what Id do without it.
Fantastic news, thank you.
Fantastic news, thank you.
I still sometimes need to double-check its answers and be critical of its responses. But when I want to confirm the answer I suspect, or know the gist of it but want more details, I find it invaluable.
It seems especially really strong in areas of science and computing. However, it consistently gives plausible but incorrect information when asked about Swedish art and culture. Though it does speak really good Swedish!
Caveat that common science education misconceptions compromise web, wikipedia, and textbook content, and thus both llm training sets and quick double-checks. So mixtral sometimes says the Sun itself is yellow (but does usually manage white), that white light is white because it contains all colors, that individual atoms cannot be seen with a naked eye because they are too small, and so on. A lot of US science education looks like training humans on low-quality trigger-and-response pairs for llm-like "explanation". I've wondered if one could do a fine-tune, or train, on science education research's lists of common misconceptions, or on less-often-bogus sources like Science/Nature journal editorial content, and research paper introductions.
I do not have an opportunity to explore these models in my job; hence my curiosity.
If you know the answer it takes less than a couple of minutes to rank all the LLMs.
Sure Gemini and chatgpt may be better at counting potatoes, but why the hell would you want a better LLM which actively obscures the truth, just for a slightly more logical brain? Its the equivalent of hiring a sociopath. Sure his grades are good, but what about the important stuff like honesty? Sure it may sound a bit OTT but issues like this will only become more apparent as more alignment continues.
Does alignment affect ROI? I have no idea.
And if anyone cares, no Im not looking to get laid, its just the first thing that would piss off an aligned LLM.
depends on the person but yeah for basically all my questions
But don't rush to dismiss it as a fringe area. Unopposed "alignment" will influence everything even slightly related to AI. It's going to be a version of modern social issues with corporate fears driving the norms (anyone who didn't live under a rock for the last ten years is aware of these), but in a subtler way. All the writings, all the articles, everything will look like max-volume DEI report. It may turn out to be a good thing in general, but also the same "good for you" as in your favorite anti-utopia.