I suspect that stone dust generally will be found to be similarly harmful to asbestos.
Asbestos is apparently worse because of the sharp edges of the particles, but if I put any angle grinder dust under the microscope I see plenty of sharp bits too.
I think the actually harmful thing is that the dust is 'fresh' rather than being the result of years of chemical weathering which tends to smooth off the sharpest pointiest bits at nanometer scale.