Hacker News Reader

Comment by mtlynch | Hacker News Reader

Kagi Ultimate (US$25/mo) includes unlimited use of all the Anthropic models.

Full disclosure: I participated in Kagi's crowdfund, so I have some financial stake in the company, but I mainly participated because I'm an enthusiastic customer.

View on HN

I'm uninformed about this, it may just be superstition, but my feeling while using Kagi in this way is that after using it for a few hours it gets a bit more forgetful. I come back the next day and it's smart again, for while. It's as if there's some kind of soft throttling going on in the background.

I'm an enthusiastic customer nonetheless, but it is curious.

I noticed this too! It's dramatic in the same chat. I'll come back the next day, and even though I still have the full convo history, and it's as if it completely forgot all my earlier instructions.

Makes sense. Keeping the conversation implieas that each new message carries the whole history, again. You need to create new chats from time to time, or throttle to a different model...

This is my biggest gripe with these LLMs. I primarily use Claude, and it exhibits the same described behavior. I'll find myself in a flow state and then somewhere around hour 3 it starts to pretend like it isn't capable of completing specific tasks that it had been performing for hours, days, weeks. For instance, I'm working on creating a few LLCs with their requisite social media handles and domain registrations. I _used_ to be able to ask Claude to check all US State LLC registrations, all major TLD domain registrations, and USPTO against particular terms and similar derivations. Then one day it just decided to stop doing this. And it tells me it can't search the web or whatever. Which is bullshit because I was verifying all of this data and ensuring it wasn't hallucinating - which it never was.

Could it be that you're running out of available context in the thread you're in?

Doubtful. I started new threads using carbon-copy prompts. I'll research some more to make sure I'm not missing anything, though.

Did you ever read Accelerando? I think it involved a large number of machine generated LLCs...

No, but I'll give the wikipedia summary a gander :)

Is that within the same chat?

The flow lately has been transforming test cases to accommodate interface changes, so I'm not asking it to remember something from several hours ago, I'm just asking it to make the "same" transformation from the previous prompt, except now to a different input.

It struggles with cases that exceed 1000 lines or so. Not that it loses track entirely at that size, it just starts making dumb mistakes.

Then after about 2 or 3 hours, the size at which it starts to struggle drops to maybe 500. A new chat doesn't seem to help, but who can say, it's a difficult thing to quantify. After 12 hours, both me and the AI are feeling fresh again. Or maybe it's just me, idk.

And if you're about to suggest that the real problem here is that there's so much tedious filler in these test cases that even an AI gets bored with them... Yes, yes it is.

> Kagi Ultimate (US$25/mo) includes unlimited use of all the Anthropic models.

What am I losing here if I switch over to this from my current Claude subscription?

You'll also lose the opportunity to use the MCP integration of Claude Desktop. It's still early on but this has huge potential

Claude projects mostly. Kagi’s assistant AI is a basic chat bot interface.

but why would clauda offer this cheaper from a third party?

It probably isn’t cheaper for Kagi per token but I assume most people don’t use up as much as they can, like with most other subscriptions.

I.e. I’ve been an Ultimate subscriber since they launched the plan and I rarely use the assistant feature because I’ve got a subscription to ChatGPT and Claude. I only use it when I want to query Llama, Gemini, or Mistral models which I don’t want to subscribe to or create API keys for.

Thanks for sponsoring my extensive use of Claude via Kagi.

Thanks for the tip! Now I'm a Kagi user too.

How would you rate Kagi Ultimate vs Arc search? IE is it scraping relevant websites live and summarising them? Or is it just access to ChatGPT and other models (with their old data).

At some point I'm going to subscribe to Kagi again (once I have a job) so be interested to see how it rates.

I've never tried Arc search, so I couldn't say.

I think it's all the LLMs + some Kagi-specific intelligence on top because you can flip web search on and off for all the chats.

I presume no access to Anthropic project?

Reply on news.ycombinator.com