More code than the entire Linux kernel? Please provide a reference. There's no way that's even remotely true.
If you compare the whole driver stack, KMD+UMDs (OGL,DX,CUDA,Vulkan) to just the kernel part of Linux, sounds about right. The KMD alone is definitely smaller than Linux kernel.