I'm not sure this is still the case or has been for some time. The maintainer of iTerm2 commented on it here https://gitlab.com/gnachman/iterm2/issues/5922 and here https://news.ycombinator.com/item?id=14800195.
Also recent versions include a metal renderer[3] (not sure if it's enabled by default) which might be even faster, I have been running it for some time but have not noticed much difference.
Another reason why it might be hard to notice is also because when one is using ssh you anyways have the network latency so might be one is simply trained not to react to latency in terminals as much.