The argument that cyclists (implied: all cyclists) ride at full speed on pavement at all times is akin to arguing that cars (implied: all cars) go over the speed limit at all times. It’s daft at best, and utterly outlandish.
You should stop and have coffee in a street shared only by pedestrians and cyclists, and observe the behaviour of cyclists. I have observed it to be mostly slow, controlled, courteous and respectful of pedestrians.