Hacker News Reader

This question is way too broad. What is your purpose? What specifically are you scraping, (ie images, text, audio, video)? Please expand

View on HN

I want to scrape all possible items of a post: video or photo when that's there, the caption, the hashtags, location tag.

If all aren't possible, which are? Want to let my users derive searchable intelligence off this info - intent is commercial.

I'm not a professional but it's depends too the social media (like scrapping Instagram it's not the same to scrapping X). Also social media fighting Instagram (blocking if to many requests are made) and they change their HTML tags. But like I said I'm not a professional in scrapping and I can make some mistakes.

Reply on news.ycombinator.com