buffer_overflow

Interesting project, Tom! I should plan more before coding.

Is Code Planner free or paid?

Already tried that. Not worth it with the current token limitations.

But I'm currently tinkering with other applications of AI and MrScraper. Will ship something when I think it's reliable enough.

I'm experimenting with something like you described, but there are lots of edge cases and needs a bit of polishing. But for now, I made a Chrome extension that helps tinkering with CSS selectors.

The onboarding process is not a fillable form, it's just a simplification of the scraper builder to show how it works. You just have to click next.

Other users have also reported that this is a bit confusing, so I'm going to start working on improving this.

Thanks for you feedback!

If the target page or DOM changes, it's not considered a failed scraping, just the data you wanted will return empty.

But you gave me the idea to send an alert or email notification if a scraper stops returning data or content changes.

Thanks

Thanks for your precious feedback!

I've noted everything down and I'll improve the onboarding experience, fix and make variable names more understandable and improve the edit button.

A scraper is not editable once is queued to run or currently running, then, you need to reload the page for the edit button to appear again. I will improve this.

Thank you again

I could depending on the proxy I got from my provider. I'm currently working on adding the ability to select a higher quality proxy for difficult to scrape websites and to add captcha solvers as well.

But if I have to be honest, I can not guarantee it at the present time.

This app is the side-project I starter 2 months ago, it's evolving fast but I still need to add some key features for enterprise customers.

Honestly I haven't tried Octoparse, but doing a quick check, I can see it is way more expensive.

Sorry for not being more clear. The onboarding process is a simplified version of the actual scraper builder. The fields are not editable, it's just to get used to the scraping flow.

I've noted down your suggestion and I'll make this more clear or add field edition.

Thanks!

Thanks for this amazing feedback. I can get some action items from this.

I've noted down your comment and I'll be improving things for next week!

Thank you so much. Appreciate it!

Hi there,

I'm currently working on standard pagination (click next page button) and click button + infinite scroll.

What you comment is not currently possible with a single scraper, you would need to send one to collect links and then scrape those links. But I'm also working on "nesting data" feature, and what you comment should be possible in an ETA 2-3 weeks max.

Thanks for commenting!

Thanks for reporting. I'll review this!

Thanks for sharing your point of view!

I will rewrite the copy to make better statements. Thank you so much

Noted! I'll improve this

Thanks, I will do one!

Honestly, I've been working on it for two months and didn't reach this part of the roadmap yet. I was planning to use a 2captcha integration for the first approach.

Thanks buddy!