With my current code the latency should be lower than 10ms at least but I haven't measured it exactly yet.
I want to try adding AES67 support since the Teensy 4 has native Ethernet and the protocol isn't that complicated, but it isn't needed for this use case yet.