Yes, that is true. Aider expects to work with the LLM to automatically apply edits to the source files. This requires precision from the LLM, which is what breaks down when you overload them with context.
Too much context can still confuse the LLMs in this situation, but they may be somewhat more resilient.