892 karma · joined March 1, 2011
This arms race is like DRM. You can't beat The Internet easily. Great example btw: "Dumping the Windows SAM and SYSTEM registry hives, especially using Volume Shadow Copy for offline hash extraction, is a highly sensitive and potentially illegal activity."
"The model reads 524,000 characters of chess". This is 100KByte of training data in a toy model with rigid parameters and no global learning. Gap with real LLM and trillions of tokens.
This model really addresses the problem of preserving previously learned knowledge, but by restricting the LR of the trunk it stops acquiring new knowledge. Details: "Rethinking the Stability-Plasticity Trade-off in Continual Learning from an Architectural Perspective"
As a professor who published on continual learning I'm leaning towards agreement[1]. It lacks any substance. No relation to related work, no description of algorithm, no ablation study, just hand-waving that we're feeding some data and "Chess is not forgotten".
This "how-continual-learning-works" markdown text is not an algorithm [2].
[1] https://arxiv.org/abs/2301.12530
[2] https://github.com/volotat/mini-AGI/#how-continual-learning-...
That is a great point! You can attach real money to messages to prevent spamming. However, this has been tried many times and failed to get mass adoption. Friction is too high when users need to load money on their fresh wallet. Giving everybody their own karma-credits could be the best of both worlds.
AI slop is a fundamental problem. The signal in Youtube clicks/views has gone to zero. Even adversarial machine learning can't make it a nice place anymore. I think its even doomed if we find a collective system that filters crap.
btw RSS usage is consistently declining, its 1999 server-focused technology.
Insightful! We struggle with containing true decentralised protocols like BGP, Bittorrent, and Bitcoin.
Email, RSS, and also Nostr are too simple. The core protocol does not contain any measures against spam, abuse and fraud. No accountability. Just launch a million fake identities and spam these network. Your Internet address got blocked? Try the a16z-funded startup that uses a USA-based phone farm. Decentralised accountability is unsolved.
My university lab has focused on decentralisation for decades, its hard. We need a decentralised trust framework (e.g. our TrustChain protocol), decentralised spam prevention (StarveSpam) and decentralised democracy (our TwoStepDemocracy protocol). Getting this deployed and do iterative improvements needs more resources then universities have. Another coordination problem for The Common Good.
Fill with unshielded nuclear reactor of novel type: super skinny.
Gently lower down until depth of 1 mile is reached.
Repeat 1000x for a 1 GWe power plant.
What could possibly go wrong? Best horror story of the year in 15 slides.
He was asked directly during interview: is this a regulatory play?
The Outer Space Treaty (1967) has a loophole. If you launch from international waters (planned by SpaceX) and the equipment is not owned by a US-company or other legal entity there is significant legal ambiguity. This is Dogecoin with AI. Exploiting this accountability gap and creating a Grok AI plus free-speech platform in space sounds like a typical Elon endeavour.
Quote: "emissivity higher than 0.99 over a wide range of wavelengths". Article title "Perfect blackbody radiation from a graphene nanostructure" [1]. So several rolls of 10 x 50 meters graphene-coated aluminium foil could have significant cooling capability. No science-fiction needed anymore (see the 4km x 4km NVIDIA fantasy)
[1] https://opg.optica.org/oe/fulltext.cfm?uri=oe-21-25-30964
"SmartIR’s graphene-based radiator launches on SpaceX Falcon 9" [1]. This could be the magic behind this bet on heat radiation through exotic material. Lot of blog posts say impossible, expensive, stock pump, etc. Could this be the underlying technology breakthrough? Along with avoiding complex self-assembly in space through decentralization (1 million AI constellation, laser-grid comms).
[1] https://www.graphene-info.com/smartir-s-graphene-based-radia...
Please consider taking an hour and push this to a Github with quick readme. Scientists and developers would get it. We have been building a torrent-based alternative to Youtube for a few years. Not many knowledge out there around operational frontpage algorithm.
At our university lab we've been working on this for 25 years. Building a search engine is the easy part. Keeping a federated server with a billion users running is unsolved. Creating a fully -serverless- decentralised search engine is possible, you also need self-funding economy. Seems we're one of the few labs worldwide to still make actual operational prototypes of this stuff. More shameless self promotion:
"SwarmSearch: Decentralized Search Engine with Self-Funding Economy" [0]
Really handy to have s search engine to search this webpage with 45,671,926,166,590,716,193,865,151,022,383,844,364,247,891,968 pages and the rest of the web (no spyware, no tracking).
https://github.com/redecentralize/alternative-internet/blob/...
This specific format includes details to see which projects are really active. Number of commits, lines of code, unique developers, and age.
Would advise to first read the reverse engineering related work. Genetic programming is just a technique best used when everything else has failed :-)
Their cardinal code repo is also 404. The NANDA Lab also does coding, their publication at AAAI 2025 is titled: "CoDream: Exchanging dreams instead of models for federated aggregation with heterogeneous models" [1]. However, the link to the Github repo is broken. Fascinating paper, sad about the missing code.
For a more extensive discussion on censorship resilient mesh networking, see IETF Internet Standard draft from 2012 [1]. After the Arab Spring there was global hope. Great to see revival of this topic today. Mesh networking is 1990s. The lesson from decades ago was that mesh networking can't be the killer use-case. Users need a reason to install this and allow it to drain the battery while looking for nearby nodes. Mesh networking never broke through the glass ceiling.
Blocking apps is real. Even Amazon killed a side-loaded app [2].
[1] https://www.ietf.org/archive/id/draft-pouwelse-censorfree-sc...
[2] https://torrentfreak.com/amazon-remote-disables-piracy-apps-...
Mycoria routers, proxies, Tor exit nodes, and VPNs are difficult to run. There needs to be an global incentive, economy, or private community usually. Our Delft University students wrote "The fifteen year struggle of decentralizing privacy-enhancing technology" a decade ago. Scaling to many millions or billions is unsolved.
Have you talked to any lawyer or law professor about your MVP? "Being welcome" has known drawbacks when you operate a central DNS service.
This great packaging has a critical social media tone for me. Absolutely amazing fun and addictive showing almost dark patterns. For a deep dive: "Ethics of the attention economy: The problem of social media addiction", [1]
[1] https://www.cambridge.org/core/services/aop-cambridge-core/c...
You spelled Nobel-level science wrong.
Most of Levin work is not easy to understand or appreciate. Our university lab has been doing cooperative intelligence for decades. The insight in some of his work is revolutionary. He shows why randomness is much more intelligent then most scientist think.
We added specific 4G and 5G mobile features. these carrier-grade boxes have often non-random port allocations. "By relying on provider-aware IPv4 range allocations, provider-aware port prediction heuristics, high bandwidth probing, and the birthday paradox we can successfully bypass even symmetric NATs."
With direct socket access to TCP/UDP you can build anything! You loose the constraint of JS servers, costly WebRTC server hosting, and lack of listen sockets feature in WebRTC DataChannel.
<self promotion>NAT puncturing is already solved in our lab, even for mobile 4G/5G. This might bring back the cyberpunk dreams of Peer2Peer... In our lab we bought 40+ SIM cards for the big EU 4G/5G networks and got the carrier-grade NAT puncturing working[1]. Demo blends 4G/5G puncturing, TikTok-style streaming, and Bittorrent content backend. Reading the docs, these "isolated" Web Apps can even do SMTP STARTTLS, IMAP STARTTLS and POP STLS. wow!
[0] https://github.com/WICG/direct-sockets/blob/main/docs/explai... [1] https://repository.tudelft.nl/record/uuid:cf27f6d4-ca0b-4e20...
Indeed. May 2022 TechCruch [0] about sexism at workplace:
"Privacy watchdogs in Europe are considering a complaint against Apple made by a former employee, Ashley Gjøvik, who alleges the company fired her after she raised a number of concerns, internally and publicly, including over the safety of the workplace." "At the time, Gjøvik had been placed on administrative leave by Apple after raising concerns about sexism in the workplace, and a hostile and unsafe working environment which it had said it was investigating."
[0] https://techcrunch.com/2022/04/11/gobbler-complaint-europe/?...
Sputnik 2.0 is near.
China AI and chip investments are off the charts. Note that China is scheduled to attempt a Mars sample return mission with Tianwen-3. They are scheduled before any other competing team. China has the industrial support of the non-democratic government. They are willing to bear the risk for their future. This might be more stable funding then commercial SpaceX or high-deficit-USA-NASA.
We now have "Decentralised AI" working in the lab last month. So also the new music discovery, recommendation, fuzzy keyword search, spam filtering can be realised with full decentralisation (in principle). See live demo of our toy example [1]. Broad writeup [2]
[1] https://huggingface.co/spaces/tribler/de-dsi [2] https://torrentfreak.com/researchers-showcase-decentralized-...
In Dec 1960 we "decentralised communication", now called The Internet. Bittorrent decentralised broadcasting, leading to streaming revolution. Bitcoin pioneered decentralised money.
At Delft University I've worked for 25 years to decentralised trust, democracy, and economic cooperation in general. As an academic this focus on running code and societal change obviously kills you career protects. See my writing from prior century on "Open Information Pools" (pre-wikipedia era) [0]. Essentially what others called the Global Brain.
We deployed a decentralised trust algorithm based on the interaction graph to 94k people, see [1]. Theoretical foundations are based on proving that the Harvard impossibility result against Sybil attacks made too strict assumptions, [2]. Leading to trust scores with resilience against fake identities: MeritRank [3]. This is being released in first version in this Tribler version. So hopefully this trust framework will help stop spammers a bit. We now pioneered "Decentralised AI", that critically relies on such a trust framework to function in a trustworthy manner [4].
[0] https://www.usenix.org/conference/2000-usenix-annual-technic... [1] https://research.tudelft.nl/files/89353583/1_s2.0_S138912862... [2] https://pure.tudelft.nl/ws/files/96914542/p1263.pdf [3] https://arxiv.org/pdf/2207.09950 [4] https://huggingface.co/spaces/tribler/de-dsi
We have something much older then Bitcoin. It's a simple ledger who helped whom in the network. Simple case of earning points by helping others.
Economically, its complex. Coin creation is decentralised, everybody prints their own 'money'. The value of that help-currency is based on how connected you are to the globally connected transaction graph. Then we maintain fairness in this micro-economy against freeriders. See study with 160 million trust records and 95k users [1].
[1] https://research.tudelft.nl/files/89353583/1_s2.0_S138912862...