The window server is "lightweight" in that it does no screen drawing itself. It is, to use Apple's term, "drawing model agnostic."
WindowServer is such a behemoth nowadays, it took me ages to reverse engineer how to make rcmd (https://lowtechguys.com/rcmd) control Stage Manager.It’s interesting to see it described as lightweight. I guess every lightweight solution becomes heavy and complex with enough usage.