A crawler is probably not the best tool for this if you use some form of site generation, as you can also use it to generate the information that goes into Typesense.
583 karma · joined October 7, 2019
[Verifying my OpenPGP key: openpgp4fpr:4BCF3BA4BE9FC8194C6FF7BC0A6BE3C9CD4A46F4]
A crawler is probably not the best tool for this if you use some form of site generation, as you can also use it to generate the information that goes into Typesense.
Action is (arguably) more important than thought in Judaism.
Yes, but there is the other side of that coin: a newspaper (as in the company) can get sued for libel or other such things, precisely because they have editorial control.
It's seems that social media companies would like to have their cake and eat it too. They are explicitly protected from their users content (thanks to section 230), and yet they seem to flex this immunity by arbitrarily blocking users, often without recourse. IIRC they have even occasionally flipped between being publisher or a platform depending on the question.
To be fair, there is no winning for large social media companies, either they preform this filtering and everyone hates on them, or they don't and everyone hates on them. I do not believe there is a perfect way to block only people who everyone agrees should be blocked, as every method has both false positives and false negatives.
Feel free to have a look around: https://github.com/chabad360/covey
AWS is paying developers to primarily work on it's needs for Linux (as that is how Linux is generally maintained, you upstream a module, you maintain it).
In Rust on the other hand (like most/all languages) new features tend to benefit everybody, AWS simply might be able to prioritize development of certain aspects, but they certainly don't get to make work almost exclusively for them.
Perhaps if youtube-dl used different examples (i.e. videos not protected by anti-circumvention) perhaps they could have avoided this.