That’s typical of tvs. The signal is delayed by a few seconds because for passive entertainment why not. You will likely have a mode for your tv that does no post processing and has minimal delay Often called pc or gaming mode. Look up “[your tv model] gaming mode”.
Check your refresh rate. With my 4k TV, the mouse gets laggy if it falls back to 30hz.
I plug my TV directly into my laptop with a USBC -> HDMI cable. Docking stations often fall back to lower refresh rates.
It might be your port or cable that doesn't support the required bandwidth to drive your hi-dpi display at the selected refresh-rate.
Usually TVs now come with a game mode that doesn't do post processing and lowers latency.