The idea of scraping fragrance ingredients for allergens is spot-on and could be a game-changer for those with sensitivities or preferences. I’ll explore how we can integrate a feature like that into the tool!
As for the scraping method, I’d be happy to share my approach! I primarily use python/brightdata/Selenium, and it’s been effective for scarping all these informations.
I can walk you through the setup if you’re interested or point you toward some resources to help you get started with it.
Crawlee is a solid choice, too, but I’d be happy to share some tips that might make things smoother for you!