I'm also experiencing this on 1 of 2 M1 MacBook Pro Max 32GB machines. I've performed a full wipe/restore on the faulty MacBook and the issue persists. WindowsServer is usually the faulty process consuming 20+ GB of RAM. The only difference between machines is one uses icloud and the other doesn't.

Given the similarities between both machines and application usage, I can't help but suspect some type of hardware issue is plaguing a percentage of machines out there.