Also, your resulting data-set would be at least an order of magnitude larger than a Stable Diffusion model.
People do use the LAION dataset for something of course. Originally maybe just for image recognition models, and now of course for image generation models.