The problem with that approach is that malware can bring its own signed driver to load and exploit.

Microsoft would need to blacklist the known vulnerable drivers to solve this problem, but then devices will stop working.