But when it comes to LLMs, I'm conscious of the fact that I'm asking deep, specific questions when it comes to programming and software, about things on the fringes that the LLM can't have read much about. In contrast, with things outside my area of expertise, I'm asking very superficial question that any practitioner of the field could answer, and so likely has many many sources for the LLM to pull information from.
With fields outside my area of expertise, I'm most often asking questions that are comparable to "what is a variable" or at most "how does A* search work". That gives me confidence that the quality of answers is likely to be much better with these questions.
https://en.wikipedia.org/wiki/Michael_Crichton#GellMannAmnes...