> both AMD and Nvidia manage their long-latency dependency tracking in hardware

This is incorrect for AMD, which has "s_waitcnt" instructions in its ISA, which is publicly documented. I believe it is also incorrect for Nvidia, but don't have the receipts to prove it.