Yes, but how good will the recall performance be? Just because your prompt fits into context doesn't mean that the model won't be overwhelmed by it.

When I last tried this with some Gemini models, they couldn't reliably identify specific scenes in a 50K word novel unless I trimmed down the context to a few thousands of words.

> Having LLMs use simpler tools like grep based on an array of similar search terms and then evaluating what comes up is faster in many cases

Sure, but then you're dependent on (you or the model) picking the right phrases to search for. With embeddings, you get much better search performance.