Can the techniques be applied for other scrapers ? Because in the article they are discussed in the context of Web Robots scraping platform.
This is relevant to frameworks that use headless or normal browser and Javascript. Plus of course jQuery to generate $.ajax requests.
I don't get what these "done()" mean. But otherwise, the logic looks good.
done() is specific to WR system. Essentially we do not know when a step is finished because it may do waiting from DOM element or Ajax requests. So a developer must place done() where he/she is sure that a step has completed.