HNHacker News
TopNewBestAskShowJobs

webrobots

234 karma · joined February 16, 2016

https://webrobots.io - web scraping/crawling platform for B2B.
submissionscomments
webrobots··on Ask HN: Hobbies/Skills which can be picked in 30s and compete at world level?
Paragliding. Physically not too difficult. It is more a mental game - chess in the sky.
webrobots··on Gandi loses data, customers told to use their own backups
Dear customer,

This mail is a follow-up to the previous email we sent (on January 8th, 2020) on this topic. As a reminder, yesterday, we experienced an incident on a storage unit at our LU-BI1 datacenter, located in Luxembourg.

Despite the replication systems in place, and the combined efforts of our technical teams throughout the night, we were unable to reover the data that was lost on the impacted storage unit.

We sincerely apologize for the inconvenience that this situation has caused. This type of incident is extremely rare in the web hosting industry.

In the event that you have a backup of your data, we suggest that you to use it to recreate your server at a different datacenter.

To help you in this, we have provided you with a promo code that will give you one free month for an instance, so that you can create a new Simple Hosting instance in a different datacenter:

    XXX
webrobots··on Ask HN: MacBook Pro Display Adapter?
Dell 27in monitor with usb-c port. It powers laptop through the same cable.
webrobots··on Advanced Ajax Techniques for Web Scraping
done() is specific to WR system. Essentially we do not know when a step is finished because it may do waiting from DOM element or Ajax requests. So a developer must place done() where he/she is sure that a step has completed.
webrobots··on Advanced Ajax Techniques for Web Scraping
This is relevant to frameworks that use headless or normal browser and Javascript. Plus of course jQuery to generate $.ajax requests.
webrobots··on Poland was shockingly liberal during the 1400s
There was also this interesting phenomenon in 1760-1790s: https://en.wikipedia.org/wiki/Republic_of_Paulava

This small republic inside the Union had economic freedom for peasants, parliament and voting right, education and medical care system - way ahead of it's time.

webrobots··on PostgreSQL 10 Beta 1 Released
Also interested in this topic. Upgrade with downtime is kind of crappy option for us.
webrobots··on Ask HN: Which developing nations have interesting tech stories at the moment?
Lithuania: Just had it's first ever proper startup exit. Oberlo was sold for $20mil to Shopify. What is interesting - Oberlo was built without VC backing in 1.5 years. This is a good morale boost for local tech community, as Lithuania always tries to measure up to Baltic sister countries Estonia (Skype and many others) and Latvia.
webrobots··on HTML to Excel data extraction
Tried on Indeed jobs listing, Amazon product search, Craigslist and cannot get it to work. I suggest you test the tool with top 10-20 most popular websites that contain listing type data. Our company also did a little side project similar to yours and packaged it as Chrome extension. We learned that it is quite hard to make a unversal tool to guess where data is. Especially that so many websites use <div> and <ul> with CSS to form table like structures instead of plain <table>. If you want, take a look at our tool: https://chrome.google.com/webstore/detail/instant-data-scrap...
webrobots··on Palantir acquires Kimono
https://webrobots.io - we give free Chrome extension to run scraper robots on your own computer. For paid customers we host robust cloud of scraping instances with all advanced features one can expect. To be fair - you need to understand javascript to write robots on our platform, we are not point-and-click doodling tool. Upside of writing robots in code - nearly unlimited possibilities with dynamic content sites, in-flight data cleaning, etc.