alightsoul

This sounds a lot like the same thing Openai did with navier stokes, but Openai is more stealthy about it.

Grok does or did the same thing, this is embarrasing

I see a new version of the web, web 4.0, being exactly this. Web 4.0 is the source of the live data. Web 4.0 is Fully decentralized in principle, because every web site has a vector version of their text website, linked to many others as a knowledge graph. The knowledge graph's links are like hyperlinks.

The vector databases might be free or paid or have ads. There is no difference between web 4.0 and an ai model that has all of it as its live data.

It is up to every client to turn that data into ai responses so in theory anyone would instantly have frontier scale ai which sounds as crazy as everyone having a computer, and the internet and the www in the 1980s.

It also, by coincidence, fully fulfils the goals of web 3.0 aka the semantic web.

Moderation of content and ranking content like a search engine would be left to the client. Or an instance like a fediverse mastodon instance or atproto with bluesky. There will be a few large models like web browsers or operating systems or social networks or fediverse instances today that will compile web 4.0 into a result in an ai agent like say Hermes and perform content moderation and ranking. You could in theory use a decensored model to perform crime like you can with the web today with Tor like selling drugs or piracy, with search engines that are not Google or defederated mastodon instances

Humans can't read raw html easily and can't read vector databases easily either. It would be read by an ai model connected to an ai agent, like a rendering engine connected to a graphical user interface

It might need a new protocol from the IETF and a standards body like the w3c? And a web server could automatically vectorize content via embeddings and link them in a decentralized knowledge graph for either graph rag after undoing vectorization or like this paper suggests being connected directly to the vectors themselves. The embeddings would be decentralized too or the website could offer them and there could be a way to translate between them

Web crawling would die and so would search engines because they would move to the user with their own ai compute and ai agent and data would already be machine readable and queryable. The data is always online and queryable programmatically so there would be no need for offline data silos. Unlike mcp servers which already do this, the data is not text based and there is no search engine to link pages to queries because the knowledge graph would be exactly that. The knowledge graph would be the new version of DNS for translation of a query into data like ip addresses into web domains because knowledge graphs are what search engines already are in a way so I don't see how a search engine would be useful except for a human to query it directly as done currently

A global distributed network of vector databases. The web for agents but there's no text. Only vectors and knowledge graphs kind of like graph rag. Web 4.0 which is vector based and makes this arxiv paper come true and decentralized like the internet or the text based www?

Every existing text web server can voluntarily offer a vector version of their website and charge for it or inject advertisements onto their content so the ai labs don't have to do it all themselves as model pretraining off a dataset. The vector version can have many links to other websites in the knowledge graph. This would be decentralized so not a monopoly and everyone not just ai labs would contribute to ai development because the dataset would be open because it would come from the internet itself as it already is (except for synthetic or user data).

That's the perfect thing to monopolize. What if, it were version two of internet content? an open search engine index? Web 3.0 turned real for answers for bots aka ai agents?

So would it be a 42 trillion parameter model, because that's how many tokens there are in the training data?

That's Taiwan's silicon shield which the taiwanese see as important. That's why japan has rapidus and the us has Intel

I would assume they want to switch to rapidus asap once it comes online

Having a us based vendor. Fujitsu is huge in Asia for ISPs and so is Mitsubishi and Sumitomo (yes they made or used to make network equipment too)

Right i forgot. That's even worse, it's a form of data poisoning but it poisons humans and not ai.

Fun fact, Fujitsu used to run their own fabs in Japan until they were sold to UMC and now they're another UMC fab although they are stuck at like the 20nm node. So this is likely made at JASM.

American exceptionalism states that America is special and unique so everyone else must be a copycat. American ai labs don't need this kind of optimization and fable will outright refuse to do it.

I mean person b found the work of person a on their own

So what if person a and person b are unrelated and person b found it on their own? There are countries in the global south that never had an industrial revolution and don't speak English and never had factories for export nor made anything in a factory industrially that isn't building material and food and maybe fuel for local consumption so they've never had an IP infringement case

Can't this be used to make a clean room implementation? Have someone write a spec then someone else who is unrelated, implement it from scratch?

They have all the WARC file cataloged on their site outside the way back machine

The internet archive's decentralization project is paused as far as I can tell. They have too many things to do and too little funding to do it all. Their current strategy seems to be establishing new legal entities outside the us like in Canada and Switzerland, but they don't accept web traffic even though they hold full copies of the internet archive. There used to be a full copy in Egypt at the library of Alexandria and another in the Netherlands. Not sure if they're still in use, but they did accept web traffic. They hold a decentralized web camp every year in the middle of a forest

Even if this is the case, this is still a valuable contribution to learn upon.

Xcancel was accused of using the twitter API. You don't have to use it. You can have a machine vision model process screenshots. You can also process the Dom. You don't offer a freely usable service or software to the public, only the final result. That final result is opinionated according to the very public accounts you want and does not offer broad scope access to accounts. You do not let the public control it nor provide a product to browse to random or posts about anything like nitter. Or you can process the content into your own news account with ai which is what most news accounts do anyways and then it becomes yours.

Is it legal to make the whole world addicted to your product? Litigation, in the same way, is a ticking time bomb for meta worldwide.

That is an European privilege. Paper costs money so in the global south companies want to get rid of it asap because money is much more scarce for everyone because many things are imported from industrialized countries

My solution to this is creating bots that repost content on sites like bluesky. The network effect can be overcome because people use a site for the content it has and not necessarily to interact with others

Of course I only do it with accounts that are very obviously intended to be public like news and government accounts otherwise x and meta can argue you were violating user privacy or some shit like that

Yes

Yeah it's a relic from when computers booted off floppy and hard disks were rare and expensive

And of course this mostly only happened and is far more noticeable in the us than elsewhere when measured in car size and people were convinced to buy the larger cars aka turned SUVs and pick up trucks by marketing. This started to happen in the 2000s

The honor 400 used to be sold for 300 dollars with 12 gb of ram. Now the replacement the honor 600 comes with 8 GB at twice the price.

And cars started getting bigger because, it was a way to legally classify them as trucks thus saving money for the manufacturer. And then everyone had to follow just to feel safe

So it's the us wanting to control their backyard. UPI is halfway across the globe so it would be harder to mess with Indians

UPI in India too. Why are they targeting pix specifically? Yappy in Panama and alipay in China but those are privately owned, as the us wants.

Banning drugs like alcohol imo is not a solution for any drug, people have their own reasons to consume them and the underlying cause should be resolved first