rbitar

I think the most exciting change announced here is the use of tool search to dynamically load tools as needed: https://developers.openai.com/api/docs/guides/tools-tool-sea...

Fantastic, this looks excellent and excited to try it

I regularly use @ key to add files to context for tasks I know require edits or patterns I want claude to follow, adds a few extra key strokes but in most cases the quality improvement is worth it

Interesting and if they are using speculative decoding that variance would make sense. Also your numbers line up with what openrouter is now publishing at 169.1tps [1]

Anthropic mentioned this model is more then twice as fast as claude sonnet 4 [2], which OpenRouter averaged at 61.72 tps for sonnet 4 [3]. If these numbers hold we're really looking at an almost 3x improvement in throughput and less then half the initial latency.

[1] https://openrouter.ai/anthropic/claude-haiku-4.5 [2] https://www.anthropic.com/news/claude-haiku-4-5 [3] https://openrouter.ai/anthropic/claude-sonnet-4

Where do you get the 220 token/second? Genuinely curious as that would be very impressive for a model comparable to sonnet 4. OpenRouter currently publishing around 116/tps[1]

[1] https://openrouter.ai/anthropic/claude-haiku-4.5

Congrats to the team, I'm surprised the industry hasn't been as impressed with their benchmarks on token throughput. We're using the Qwen 3 Coder 480b model and seeing ~2000 tokens/second, which is easily 10-20x faster then most LLM models on the market. Even some of the fastest models still only achieve 100-150 tokens / second (see OpenRouter stats by provider). I do feel after around 300-400 tokens/second the gains in speed feel more incremental, so if there was a model at 300+ tokens/second, I would consider that a very competitive alternative.

Really excited for this product, the industry needs alternatives to WebContainers which has become more restrictive around licensing. Also great to see that non-node runtimes (ruby / python) will be supported. Having said that, really wish this was open-source, even if that meant the OSS version had more limited features then the commercial alternative.

This token throughput is incredible and going to set a new bar in the industry. The main issue with the cerebras code plan is that number of requests/minute is throttled, and with agentic coding systems each tool call is treated as new "message" so you can easily hit the api limits (10 messages/minute).

One workaround we're doing now that seems to work is use claude for all tasks but delegate specific tools with cerebras/qwen-3-coder-480b model to generate files or other token heavy tasks to avoid spiking the total number of requests. This has cost and latency consequences (and adds complexity to the code), but until those throttle limits are lifted seems to be a good combo. I also find that claude has better quality with tool selection when the number of tools required is > 15 which our current setup has.

Frontend.co | REMOTE | Full-time & Part-time | https://www.frontend.co

Frontend is building an AI-powered Shopify development platform. We use AI to generate full-stack application built using Next.js / Tailwind for Shopify-connected storefronts.

Experience: 7-10+ years as a full-stack experience with recent experience using TypeScript, Next.js, Tailwindcss, Postgres, and Ruby on Rails. E-commerce development using Shopify GraphQL APIs is a plus. Our tech stack is:

- Next.js - Supabase / Postgres - TypeScript - Tailwind - Ruby on Rails - Shopify Storefront + Admin GraphQL APIs

Send us a note at: info[plus]hn@frontend.co

Self-hosting is definitely something we are keen to explore as most of the cloud solutions have resource constrains (ie, total active MicroVMs and/or specs per VM) and managing billing gets complicated even with hibernation features. Great project and we'll definitely take it for a spin

Looks great and excited to try this out. We’ve also had success using CodeSandbox SDK and E2B, can you share some thoughts on how you compare or future direction? Do you also use Firecracker under the hood?

Excited to try this out, it will solve two problems we’ve had: applying a code diff reliably and selecting which files from a large codebase to use for context.

We quickly discovered that RAG using a similarity search over embedded vectors can easily miss relevant files, unless we cast a very wide net during retrieval.

We’ve also had trouble getting any LLM to generate a diff format (such as universal diff) reliably so your approach to applying a patch is exciting.

This looks great, glad to see this project and congrats on the launch. Having said that, how does this project fit in with the Shopify Hydrogen effort using Remix / React? There seems to be an ever growing number of ways to build a shopify storefront these days (ie, native templates, remix/hydrogen, web components, Shopify JS Buy SDK, etc.) so it's not clear what technology to "bet on" from a developer perspective.

Separately, nice touch adding the refined LLM instructions, this looks like a nice pattern for other UI frameworks to follow.

RubyLLM has been a joy to work with so nice to see it’s being used here. This project is also great and will make it easier to build an agent that can fetch data outside of the codebase for context and/or experiment with different system prompts. I’ve been a personal fan of claude code but this will be fun to work with

SEEKING WORK | New York, Florida | Remote Only

- Website: www.skillhire.com

- Email: info+hn@skillhire.com

SkillHire is a community of vetted, Freelance software developers for hire. We work primarily with startups to scale their engineering teams with a remote dev team.

Common tech stacks we work with include React, React Native (iOS), Node, and Ruby on Rails.

Drop us a line if we can help you build or augment your eng team.

We help senior remote developers around the world contract with companies here in the US, mostly Startups, for freelance work. Feel free to check us out at Skillhire.com

You’ll have to go through a technical interview process but most jobs are seeking JS developers, especially Node, React-Redux and React Native devs.

Hopefully we’re one more resource to help devs like yourself who want to travel and work.

SEEKING FREELANCER - Remote OK

Type: Freelance Ruby on Rails or React engineer

Location: Based in LA / NYC

Interested in a strong Ruby / Rails developer, preferably full-stack (we use HAML and React) or someone who is comfortable as a tech lead. Ideal if you have experience with Spree or Solidus (eCommerce). We're building a content / commerce site using React + Rails on the backend. If you have some DevOps experience using Docker on EC2, even better.

Contact: rami@goop.com

If it helps, we work with startups/brands/agencies that primarily hire remote developers across a range of languages at FlexDevs: http://FlexDevs.com

I'm the developer/founder of the site. I'm pivoting Cofoundr from its initial purpose as a social community to a flash sales site for founders. I am planning on sending offers I would actually find useful myself (more focus on quality rather than frequency). Any feedback you guys have would be helpful.

After seeing this marvelous bit of hackery I've subscribed to blog. Anyone with that level of curiosity must certainly have other interesting knowledge to share.

Yes, there are. Follow the link and notice the redirect embeds params for the affiliate link.

Correct, the rate is a string field so has a 255 char limit. It was mostly intended for short values such as "$100 / hr"

I'm the author. Feel free to email me anything at rbitar [at] gmail.

I was using SendGrid for email delivery and needed to upgrade the plan since I reached my limit. It should work now.

Good idea. I'll add a GitHub field.

I don't think I've removed any profiles. I can look into this if you like.

Right, thats the best way for now. If you still have trouble, feel free to email me (email is on my profile).

Its a text based search and I'm working on some simple query expansion to resolve SF / Bay Area / San Francisco type queries as the same. There are still a few open questions for implementing proximity search ...

At the moment "more complete" profiles are ranked higher. But I agree, there should be some randomization introduced.

Hey Ben,

I created hnhackers a few hours after the spreadsheet was posted on HN. Here is my original post on HN: http://news.ycombinator.com/item?id=1264544

I thought this would be a better way for us HN consultants to connect, but I'm happy to remove you from the DB if you prefer. My email is in my profile.

note that I've addressed most of the issue in the original post but let me know if you have any other feedback.