I would recommend PhantomJS: http://www.phantomjs.org/
It's not a crawler per-se, but you can fairly easily build one based on it. It supports everything that modern browsers do - it's a headless WebKit, driven from JavaScript, after all.
It's not a crawler per-se, but you can fairly easily build one based on it. It supports everything that modern browsers do - it's a headless WebKit, driven from JavaScript, after all.
No comments yet.