> A lot of devices are not compliant though
That's exactly the problem, there was no standard protocol for communication over Zigbee. Manufacturers could implement whatever they wanted on top of it and put the Zigbee logo, like you can put the WiFi logo on a device that speaks a proprietary protocol over WiFi. You bought into an ecosystem and if you wanted a device from outside of it, you needed another hub.
> So your Zigbee light switch will probably workout any fuss
Big "depends". Out of the box it will only work for the few manufacturers who look to be compatible with some other hubs. I tested a lot of basic devices (simple switches or bulbs) with various hubs with little success. Philips, IKEA, Bosch, Tuya, Aqara, Osram, etc. Couldn't discover, add, or control them properly without the corresponding hub.
If you use a device with HA and a Zigbee stick (router/coordinator) then you benefit from a lot of development done in the background to "translate" between all the variations. But that's not something non-techies want to deal with, it's too much of a hassle.
This is the problem that Matter solves. Certified devices must implement the standard communication protocol over the network of choice. So no matter the manufacturer, if I see a Matter logo I know the device will work with my Matter.