I have a strange lag problem too.
My CapsLock key (mapped to Esc because I am a Doom Emacs User) gets really slow over days. Like in ~4 seconds to register. A reboot fixed the delay. But it degrades again.
Happened twice. Thankfully, after the last reboot, it seems to be holding.
Last year MBP running Big Sur.