I'm not familiar with the Netherlands, but in Belgium legislation was introduced to tackle that problem. Above 25km/h, they are essentially considered motorcycles, requiring a similar driver's license and follow the motorcycle rules of the road. (https://www.vlaanderen.be/speedpedelec)
E-scooters are limited to 25km/h and follow cyclist rules, e.g. they cannot be used on sidewalks.
The number of speed pedelecs in the Flanders region is relatively high, because many companies have started offering leased e-bikes as a way to do tax optimization. (sadly, the same tax incentive exists for car leasing, so the number of cars on the road is still too damn high)