Well most people don't verify identity with some sort of physical key. So it doesn't work as an analogy in the first place for signatures...