Hacker News Reader

Important to note though, that even if they say it has 200k context, there's a good chance it won't be able to use all of it.

For example, here is an experiment on long context recall for Claude and GPT4:

Even though claude claims 200k tokens context, perfect memory stops at about 19k tokens.

I'd personally expect the Yi-34b models to perform even worse at the task, though I have not tested it.