1,956 karma · joined June 20, 2020
Starting in 2025, the Vera C. Rubin Observatory in Chile — funded by the National Science Foundation — will catalog the solar system from the ground...
"It took us 200 years to discover all the asteroids we know to date, about 1.2 million asteroids," Mario Jurić, the Rubin Observatory's solar system discovery team lead and the director of the University of Washington's DiRAC Institute, told Astronomy. "In the first three to six months of Rubin, we will double that."
That's one additional ground based observatory coming online in the Southern hemisphere. If we get our act together and build a lot more of these and other space based observatories we're going to see the true scope of the "shooting gallery". We really need to raise public awareness of this, as a planet based civilization we are taking our chances by ignoring the problem and assuming everything will be fine for a hundred or a thousand more years. All of our efforts at averting a climate catastrophe will be for naught if we get smoked by a rock big enough to fill the atmosphere with particulate matter and drop global temperatures for years afterward let alone anything bigger resulting in global firestorms and tsunamis.
Also, if you're in constant pain you'll try all kinds of random stuff to make the pain go away. If necessity is the mother of invention then desperation is its father.
1) The data scraped from the web is filtered, deduped, ranked, and cleaned in a variety of other ways before being used for training. While quantity is necessary for a model to learn the structure of language, quality is even more important once you have a model that can produce coherent output so a lot of work goes into grooming the data.
2) There have been a bunch of papers and training runs that show synthetic data created specifically for training a model is as good or better than scraped human produced data. The importance of scraped web content is quickly declining because you can now generate infinite higher quality examples using existing trained models. The only relevance it has now is for knowledge about new developments and that is a much easier stream to filter since most of the important stuff comes from official sources and you don't need as many variations since you can just generate your own using one or more examples.
Now, how do we fix this? YouTube's ad model sucks. Their algorithm sucks. Their front page sucks. They've captured a bunch of creators though so often YouTube is the only place you can find someone.
I want those creators to benefit from me viewing their videos. I want the fact that I view a video and like it to help other people find that video in their recommendations. I want an algorithm that shows me things that are interesting and relevant not one that promotes the spammiest and most ad heavy videos that barely have anything to do with my watch history.
Having an alternative front end is nice but I don't want to rob YouTube of the money they spend on hosting the videos.
So, how do we do this?
Peer to peer fails when there is little interest in something or when most people leech and it sucks for archiving old content.
Hosting it all in one place is super expensive and hard for a small group to manage without turning into YouTube.
Maybe we could find a way for the creators to host their own content and get paid when people view it while being part of a large federated network for easy discoverability?
Please list any projects you know of, I'm sure there are a lot of people here who would be willing to contribute or donate.
Granted, advertising has been taken to the extreme and there wouldn't be harm in cutting back on it to a certain degree, you just can't get rid of all of it so it is in fact one of those jobs that need doing.
The point of my comment is that you can say the same thing about every pair of thing someone wants to do and thing someone needs done and the essential part is that it doesn't matter what the second thing is, people would still complain that all this talent for A was being wasted because they were working on B instead but it's not a waste for a variety of reasons one of which is that there is not enough demand for A. You could easily say someone is a psycopath or antisocial if they choose to spend all their time doing something that isn't needed or not wanted instead of doing the things that other people need done. You would at the very least say they are selfish.
I believe this has been true throughout human history. The greatest artists and thinkers throughout history have earned their keep by providing services to the wealthy or teaching paying students (also often wealthy).
There are upsides, the artists get to eat but they also have all the benefits of being connected to their employer/patron including time spent practicing their craft. If they were to quit and focus on pure art then they would likely earn far, far less and possibly spend less time making any kind of art commercial or not.
It reminds me of this survey that made the front page not long ago about author's that contained this illuminating paragraph:
> While 80% of respondents considered themselves to be professional authors, only 35% said they were full-time authors while 53% said they were part-time authors (with the balance being one-book authors or undecided). The primary writing occupation of part-time authors outside of publishing books was professor/academic (8.5%), followed by book illustrator/author (4.2%), editor (2.9%), poet (2.4%), journalist (2%), teacher (2%), and entrepreneur (1.5%).
So even people who consider themselves professional authors are unable to work at it full time. It makes sense, there's only so much one person can produce and it's quite difficult to find an audience willing to pay for what you make. This likely holds true across all professions i.e. you have to do the work that they want done and not the work that you want to do.
https://www.publishersweekly.com/pw/by-topic/industry-news/p...