I guess you would be paying for pushing all of these tokens to the LLM. Also, too much irrelevant context can "confuse" the model about the task at hand
Maybe you're right about the confusion...but given the velocity, that's going to be fixed also.
All the knowledge about the field of programming is digitized, one could argue that having a model that digested all that information in a right way, is better than separate.
Just a thought. I don't care all that much.