Try for yourself. I get 4k120Hz when connecting my laptop directly via HDMI.
Edit: I should add, I do get 4K120 VRR and HDR on the M1 Macs when connected to a monitor via Thunderbolt or Thunderbolt to DisplayPort adapter, and I would expect a Steam Machine to be similar using DisplayPort, but my TV only has HDMI input and so can’t work in this mode (and a Thunderbolt to HDMI adapter doesn’t work either).