1,696 karma · joined June 23, 2013
Rankings for text are here https://arena.ai/leaderboard/text
For comparison of Free Tiers: - Gemini serves 3.6-flash (rank 12) - ChatGPT serves 5.5-Instant (rank 23) - Claude serves Sonnet 5 (rank 27) - Meta AI serves muse-spark-1.1 (rank 5)
While Meta AI serves the better ranked model, it doesn't end up working that well for other things. For example, if I ask "help me buy a new raincoat", it ends up suggesting a Cambodian website, whereas Google is well integrated with Google shopping. It doesn't have the same integration with GApps outside of Gmail/Calendar. A few other email connectors are available.
Claude has one of the best interfaces with connectors, skills, and plugins galore, but the model and limits are restrictive on the free tier.
Gemini, as far as I know, I've never hit a rate limit on Flash.
I believe Gemini is going to gain market share through the free tier funnel while serving models as cost-effectively as possible. People are going to use Gemini because they use GApps and Google.
ChatGPT and Anthropic are going to be competing for the API/Business users, but for everyone else they are going have to become Google before Google becomes them.
Plus they are probably running these things on every Google search so saving tokens is a huge win for them.
Also, if you don’t want to use social media or watch YouTube, you can save battery life on a smaller screen, gain durability, and carry a lower weight phone.
Agent: https://arena.ai/leaderboard/agent
Web dev: https://arena.ai/leaderboard/code/webdev
Currently Fable and 5.6 are neck and neck on web dev which is basically the same finding as this.
https://arena.ai/leaderboard/agent
5.6 isn’t on there yet but Fable leads by a significant margin atm
https://www.who.int/europe/news/item/04-01-2023-no-level-of-...
I guess for coding if you’re not first you’re last, but this is damn impressive considering. It looked like they pulled the coding model from the benchmarks, but it was similar.
Or ask Gemini what the best deal is, it’s found some good ones.
For smaller stuff, Amazon is usually better than Target or whatever box store nearby.
Tbh I don’t really feel this way. We all agree hands down that Macbook has the best hardware. Apple Silicon has been a huge success for speed and power consumption. I haven’t used the newest macOS but like the butterfly keyboard and touch bar I assume they’ll work out (or fix by reverting) the issues. It’s probably not even that bad. Sonoma is still receiving security updates so I’m good for now.
And most of the things that people want in a non-MacBook laptop are still a few years before falling off patent.
I’m fine waiting and playing around with Framework or Steam machines until then if I need another hobby.