I think 88 of the 96 cores per cou are assigned to the VM and the rest are assigned to the underlying hypervisor. I remember seeing that somewhere.
The OS needs cores and RAM to be able to keep the system up. Everything from network cards to services need some spare power, otherwise things go very wrong, and the experience of the tenant becomes very bad.