pranade

Yes, thanks for spotting. We'd discovered that Chinese, Japanese and Korean failed but didn't know about these characters. Thanks!

Thanks for letting us know. We've tested on some versions of Firefox, but not v26 on Mavericks. We'll look into this

It's a great question. What we're really trying to do is make data accessible programmatically and at scale. We want to connect data providers and data consumers with APIs in a way that's mutually beneficial vs. being a tool for data theft. Our hope is to (once we scale) actually work with data providers directly on the on the distribution of their data so the IP ban becomes a non-issue.

Not yet, but it's our #1 feature request, so we're working on it now. For now, you can make multiple APIs (one for each URL). If the URL takes query parameters though, you can re-use the same API and programmatically cycle through query parameters.

Thanks a ton for the feedback. Getting data from multiple similarly structured URLs programmatically is something we're working on now. We love hearing about the use cases you want to use this for so we can make sure we build out the right features to make kimono useful for you.

So sorry for missing this earlier. See our response in comments below: "At the moment, we rely on users to be responsible. We spell it out in the terms and FAQ. We've been in private beta, keeping usage very limited until today. We fully understand the seriousness of the issue as we scale. We're committed to becoming a responsible bot that respects robots.txt"

Yes, you're right... we can't handle angular quite yet. We're working on this.

At the moment, we rely on users to be responsible. We spell it out in the terms and FAQ. We've been in private beta, keeping usage very limited until today. We fully understand the seriousness of the issue as we scale. We're committed to becoming a responsible bot that respects robots.txt

Thanks for flagging. We'll get on this to figure out what's going on when running on ubuntu

Kimono can handle several pages with malformed and old/bad HTML. We're still in beta though, so we're handling more edge cases as we encounter them. Should work on HN main page.

Yes, we're excited about the possibilities of an end-to-end use case as well... in fact we were surprised when we found a lot of interest in front-end output layers on top of the APIs than just the APIs themselves. Would be curious to know what output features would be most valuable for you.

There's definitely things that a custom-built scraper can do more efficiently than kimono, but our focus right now making scraping accessible across a broad enough range of web sites.

Thanks for the feedback. We're working on a feature that will allow you to edit APIs you've created and also edit the selectors and regex (right now, in advanced mode, you can see them, but cannot edit). We're looking into your bug now...

Thanks for the suggestions on tool tips... We can also expand the tutorials section to make this more clear.

It's pretty homegrown right now, we did the intro video ourselves on our laptops

Thanks for the suggestions!

Thanks for the suggestion... adding to the list :)

We don't support that quite yet. It's our #1 feature request though, and we're working to get it ready soon

No, we don't have POST support quite yet. We're working on a solution.

Love your suggestion. We're committed to making kimono better and we're working on it all the time. We want to make sure it's a responsible scraper, so want to work together with webmasters in cases where there might be blocking but the data is legal to share...

Yes, it's one of the most popular feature requests. We don't support auth yet, but it's on our shortlist and we hope to have it ready soon.

Yes, it's a great point. We're working on updating the query param passthrough to handle params within the URL structure.

Yes, we're in beta right now, while we're still working out the bugs. For beta, it's free for 30 APIs.

Thanks for letting us know. Just tried and am getting the same error. The page is loading content dynamically from another source... We'll look into this and see if we can get it working on this page

Thanks - we're not using flash, so it must be something else. Will follow up over email

Great add. It's on our shortlist - a popular request!

Yes, in concept quite similar. We wanted to make something that you can use from within your browser as part of your natural workflow, without installing any other software.We also really wanted to figure out the right data association intelligently based on user selections vs. asking users to think through a data model up front

Thanks a ton for sharing... the association algorithms have been where we've been spending a good chunk of time. Will read through this

Yeah, we've been working on this for a while too... took a while to polish it a bit before we could put it out there. Will check out exfiltrate.org - looks cool!

It's probably our #1 feature request at the moment. We're working on it and hope to have it ready for you to try soon