> Videos start playing as if I have hovered onto them...

IIRC YouTube actually has a dedicated option in video playback settings to disable "video previews" when hovering over the thumbnail