How are you checking that the AI is not just gaming your correctness tests? It's very easy to write incorrect synchronization for example.
Comparison is simply byte by byte equalness check of reference kernel outputs with candidate (optimized) outputs.
Why I added ai generated inputs then? I was just being lazy and this was more of a langgraph playground for me:)