The law is not as clear cut as people imagine it to be. In many cases the text of the law is less important than precedent and established practice.
The law is not as clear cut as people imagine it to be. In many cases the text of the law is less important than precedent and established practice.
The price of losing a weak case against a new search engine would be worse for an existing one than avoiding litigation and instead relying on other methods of blocking competition.
The OP who admits he is not a lawyer yet proceeds to advise others. Why? He cannot distinguish the difference between scraping and publishing scraped content or between something being "illegal", i.e. a criminal offense, versus something legal that someone perceives as violating their "rights" and prompts them to file a civil suit. As is typical in the US, such suits may ultimately be meritless and purely used to intimidate.
There are law firms that make money from convincing people to file civil suits against potential competitors. They might list a number of potential causes of action against someone who visits your website. You might be able to sue your users. It does not mean you will win. In losing, you may create legal precedent that in effect enables more of them to violate your "rights".
LinkedIn is taking a calculated risk. If they continue to sue web users who use automation (as does LinkedIn), not every defendant is going be intimidated. Some will defend themselves. I think one of them is going to win.
It is one thing to purport to limit how someone can use some data that you provide to them. That is not "scraping". That is something else. It is another thing to purport to limit how someone can choose to use their own computer, i.e., interactively versus non-interactively (automation).
https://www.vice.com/en_us/article/mgxqb8/the-man-who-broke-...
[1]https://en.wikipedia.org/wiki/Ancillary_copyright_for_press_...
In that case a Google without the privacy issues is basically the same as duckduckgo.
Payment and privacy are a very problematic combination, especially where end-to-end encryption is essentially impossible.
You pretty much get to choose one or the other.
One inevitable and useful bias a search engine has is the bias against spam. It's aligned with the interests of the user.
There can be (and are) biases that are against the users' interests but are aligned with operator's: promotion of some content, censorship of other content. This bias I would rather see gone.
It didn't work well enough because back in 2000, Yahoo was one of the first companies to license Google's search engine. (The previous year, AOL licensed Google's search engine.)
Yahoo incorrectly thought that their "portal" and user-submitted "directories" were more important to web surfers than search algorithms like Google's Pagerank. They eventually realized their misjudgment and then tried to build a Google clone through acquisitions like Inktomi and Overture:
https://www.cnet.com/g00/news/yahoo-to-acquire-inktomi/
https://www.cbsnews.com/news/yahoo-buys-search-engine/
https://www.cnet.com/g00/news/yahoo-dumps-google-search-tech...
Even today anyone who wants to opt out of being in the Google (or MSFT, or whoever) search engine can trivially do so by updating their robots.txt. Very very few sites choose to do so.