Personally I think the main difference is that normal bikes are self-regulated by the stamina of the rider. It takes a lot of extra effort to ride a standard bike fast and erratically, you are self-incentivised by your own exhaustion to ride smoothly and at a moderate pace.

Not the case for an e-bike where you have no reason to not just ride around everywhere at 20+ mph while barely paying attention.