My previous TV had about 150 ms of video latency. Even if I enabled Game Mode, it was 75 ms, which was still noticeable.
With my current TV, I have no idea what the latency is because I stopped gaming on console and so I'm not playing Rock Band which had a calibration option to compensate for video and audio latency.
If you don't configure your TV correctly sure, you could get massive amounts of lag. Even with an OLED display if you turn on all the post processing you're going to have problems. That's not really a fault of the TV though. I disable almost all post processing on my TVs and get a better picture without the downsides.
With digital receivers adding lag is minimal at best. Especially with newer models that don't draw on top of the source signal.
For example, my LG OLED tv is regarded as one of the best for gaming. Game mode latency is about 9ms. Cinema mode is about 90ms.