I imagine OpenAI et al are saving all LLM output. Soon they can offer an anti-cheating service that checks a given submission to see if it was generated by their program.