Hacker News Reader

JonathanChavezon Show HN: TokenMaxxer – track every AI token you spend across your coding tools

i found it great, really useful to track token spending per model

JonathanChavezon Show HN: I built the LLM Comparison Tool I wish existed

Thanks!

Not yet, but there will be. I'm going through a migration of the schema to allow for this

JonathanChavezon A tool to compare LLMs [Open Data]

Thanks for your feedback.

I just added Cerebras, initially I could not find the pricing for it since it was not documented publicly.

A small project I have is to do an analysis of data coverage for each entity and put it in a dedicated section about the methodology I use to fetch the data.

PS. ArtificialAnalysis looks really cool.

JonathanChavezon A tool to compare LLMs [Open Data]

Hey HN, I built this site to compare provider metrics and benchmark results between models.

All the data is open and with references. Here: https://github.com/JonathanChavezTamales/LLMStats

I hope this is useful. It was created using Sonnet 3.5 + o1 + Cursor.

Let me know if you have any feedback! Thanks.

PS:

It's hard to compare providers' quality because they use different precision at inference. Also, some labs cherry pick the benchmarks they want to report for their models. Medium term goal is to run the evals myself.