I don't know about the latency that's intentionally inserted. But I'm using Karabiner for the past years, and I haven't noticed any. It probably helps that it's implemented as a kernel module.