The bitter lesson would suggest eventually the LM agent will train itself, brute force, on something and extract the context itself. Perhaps it will scrape all your policy documents and figure out which ones are most recently dated.