The real problem, in fact the only problem in my opinion, is the "guilty until proven innocent" approach of the state. They are sending letters which state that the license has already been revoked! If they sent a letter saying "we strongly suspect fraud, you must verify your identity in 30 days", I would not have a problem with that, as long as they have a decent match.
Instead, we get talk about how "driving is a privilege". Guess what - working for the state is also a privilege, and people who abuse the citizens who pay their salaries should lose it.