Completely agree, and as a user of Desktop Linux for a very long time - I always felt that Linux GUI have been inferior to the options available on Mac and Windows.
It's not for everyone, but I found a personal solution with tiling window managers (Xmonad, I3) and related tools (suckless' dmenu). They restore sanity by providing lightweight, shortcut focused GUI systems, that don't intrude but provide enough functionality to get things done.
For anyone searching and testing GUIs like XFCE, don't dismiss tiling window managers as being too complicated or a bridge too far. My experience is that they work wonderfully in practice.