What about a keyboard? How are you going to log in if your computer won't accept the keyboard that you are trying to plug in?
I'd notice a new usb plugged in, but I wouldn't easily notice this.
This is the reason why keyboard/mouse connectors should look different to USB connectors, so we can tell the difference.