How can it be legal to charge a higher fee for the Fable model, if most of the usage will default to a cheaper model behind the scenes?
It is one thing if I, as the user, choose to down-level but Claude shouldn't do this on its own.
It is one thing if I, as the user, choose to down-level but Claude shouldn't do this on its own.
"You won't be charged Fable prices for rerouted requests. Learn more about how the fallback experience works."
https://www.anthropic.com/claude/fable Under "Safeguards"
I couldn't find if they refund the tokens for that session or the customer is SOL.
This is the new normal.
Knowing Anthropic, it wouldn't surprise me if it will result in a full cache miss/rewrite at fallback, with potentially up to 1M tokens in the context window.
Fable requests that fall back to Opus do not charge the cache miss cost of Opus.
Not like you can tell the difference if you dont own any of the implementation.