The most expensive four words in the English language: “This time is different”
blog.dshr.org
blog.dshr.org
The Four Most Expensive Words in the English Language: "This time is different"
Anyway, on to the actual topic... I need to sit down to give this more thought, but I still think there's value in P2P networks, and it's worth pursuing. You should be able to easily replicate and share content that you care about. The big incentive is being able to keep your own copy and being able to do whatever you want with it. How many times have you tried searching for an old YouTube video, only to find it got taken down?
Another example: package managers! You want to have a machine-local cache, a remote cache for reproducible builds and deployments, and whatever other remotes you get the original packages from. Maybe different registries have varying content policies, and you can pick your favorites. If you have a few developers in an office it's a lot faster to grab dependencies from the laptop of the person sitting next to you than a CDN.
My argument against this is just because it's purely peer-to-peer, it doesn't always directly mean it's an overall improvement in the user experience.
> You should be able to easily replicate and share content that you care about.
Yes there is definitely value in that, I even agree with there! But I personally think turning the whole thing into a completely peer-to-peer approach isn't the answer. It's the raw shit problems about bandwidth capability and network latency which really matters - which, if you've tried streaming from utorrent/bittorrent before, it's very obvious that the experience is still greatly affected by the lack of a little centralization that YouTube has.
> The big incentive is being able to keep your own copy and being able to do whatever you want with it. How many times have you tried searching for an old YouTube video, only to find it got taken down?
Neutral on this, very nuanced since most of the time it involves legal issues and opinionated perspectives, lol.
The reason why we don't see monocultures in nature is because they put every single one of their members at risk of sudden death. A single pathogen can wipe them out. The exhaustion of resources required to sustain them can starve them. The build up of by products can kill them. Think of a medieval town drowning in excrement, running out of top soil and about to get hit by the plague.
An ecology on the other hand puts none of their members at risk by virtue of their existence because they are diluted. Think of a band of hunter gatherers, they might individually die at 40, be exposed to ebola and worse, but the fact they are so widely separated and so few means that they have few if any vulnerabilities that can kill the whole tribe.
The reason why we see monocultures now is because they are more efficient and our time horizons are tiny. Amazon will fail catastrophically. Billions or trillions will be lost. No one will learn anything because it's cheaper not to than to build a really resilient network.
To wit, there are massive redwood forests that occur in nature that are just one cloned genome. These are reproductively successful on timespans many times a human life.
Is Amazon itself a monoculture? Is that relevant? Is enforcement of law by the state a monoculture? There's a lot of evidence to suggest that centralized information management entities are actually much more robust in the long term than a loose confederation of peers.
That there is a massive monoculture in an area that was an extreme desert until as little as 5000 years ago makes my point that a monoculture is more efficient in the short term. A human life is a terrible stick to measure geological time, one might as well measure success in the stock market using an atomic clock.
I have not defined what a monoculture is because it should be obvious by the name. Likewise for ecology.
>Is Amazon itself a monoculture? Is that relevant?
Yes. And because monocultures are prone to sudden collapses.
>Is enforcement of law by the state a monoculture?
Depends on the number of states. Depends on the diversity of laws between the states.
>There's a lot of evidence to suggest that centralized information management entities are actually much more robust in the long term than a loose confederation of peers.
The fact that we don't observe this in nature, or that the few times we do observe it is either before or after a mass extinction event should tell you that evidence has too narrow a time horizon.
1. How relevant "natural" ecology is to understanding longevity of modern culture: unclear, probably not very.
2. Monocultures by nature are less robust, even in the context of human society: well, you need only examine how quickly distributed hunter gatherers were exterminated by less distributed agrarian societies, who were in turn more swiftly replaced by more centralized industrialized societies...
My personal hypothesis: It's probably more reasonable to say that humans were the first aspect of natural ecology to get really deep into economies of scale, and by virtue of that, retained a monopoly on that incredible power relative to the rest of natural ecology.
Anyway, I don't understand the religion of distribution (especially in context of finite resources). Yes, distributed systems are more robust. But they pay for this by being massively less efficient than equivalent centralized ones. It's a fair tradeoff, but a tradeoff. It's like 5 people in a (single) car vs. 5 people on bicycles. Which setup is better depends on where those people want to go.
What we have is either ten people walking or 10,000 people strapped in the space shuttle cargo bay. That it takes the ten people 30 years to walk from Lisbon to Singapore vs 45 minutes with the shuttle isn't the right comparison. It's that the shuttle explodes 2% of the time.
That you are forcing me to be with you on the shuttle because you don't understand the risks should be all the reasons we need for walking instead.
There may be some wins for the specific case of loading something from someone on the same LAN as you, but that's probably not something that can sustain a P2P storage market.
I think there's a market for impossible to take down information. The competitors aren't the Amazons of the world, more like whomever is hosting Scihub.
I'm not sure if i agree with that, but there once was a time when the only people who would ever need a decentralized network were the military, and the benefits did generalize to everyone.
I think it's too early to tell.
One of his major projects is LOCKSS -- a decentralized P2P network for preserving articles. https://www.lockss.org/news-media/blog/
In tech we have this habit of going from, "Wouldn't it be cool if X..." to "Let's build X right now!" I think that's a fine instinct if it hasn't been tried and it's something that runs on the author's machines. Something will be learned.
But when we're talking real money and real work from a lot of people, I think it's worth stopping and asking some questions. Yes, sure, X would be cool. But are there perhaps subtle reasons why X has not happened yet? As with jetpacks and 3D video, sometimes cool things are impractical or don't pay off as much as you'd first think.
The new way is: The (singular) most expensive four words "this time is different".
The original parses as The four most expensive works (plural) "this","time","is", "different".
We still don't have a standard open equivalent of Dropbox.js (deprecated).
That is, a user controlled account which a browser or phone knows about that can store files, and that every app that needs to store files can read and write to.
Proprietary solutions and B2B solutions will never meet that need - it needs to be something that all the big tech companies can get behind, and which consumers have visibility and control of.
I can't see a route to such a protocol right now, in terms of either technology or finance, other than something open source and based on a cryptocurrency. As such, I hope one of them succeeds.
Even if all the files end up stored in Amazon, at least the protocol will be open and everything will be encrypted. And you will be able to trivially as a consumer store the data on a competitor (Microsoft, Google, Baidu), or on your own server if you want or need (countries and companies and people at risk of human rights violations may care).
Note how ubiquitous git is now as such a filesystem and protocol for developers.
Remember how that has come about over the last 10 years.
Imagine the same thing happening with a consumer targetted file storage system and protocol.
Cryptocurrencies aren’t really up to that since it’s unlikely to lead to the kind of lottery returns VCs are chasing — the most people are going to pay is capped at Dropbox/iCloud/etc. rates — and the volatility makes it hard to sustain years of development to make something stable enough to trust and easy to use.
Almost any client you can dream of can access IMAP mailboxes and send through SMTP.
That is exactly what I said about a year ago, although I predicted centralization on BackBlaze instead of S3 because they had lower costs: https://news.ycombinator.com/item?id=14988800
You have to look at the specific context his essay is about.
Torrents are popular for data that many participants desire such as "StarWars_1080p.mp4" and "LadyGaga_album.mp3".
Torrents do not work for a 500GB encrypted backup of "JohnDoe_personal_vacation_photos_20180621.zip". There's no financial incentive for others to download and store it so the number of seeeds/peers will be 0.
His essay is not about a p2p version of Netflix or Spotify (e.g. bittorrent or Napster). He's talking about a p2p version of "cloud storage" such as BackBlaze/AmazonS3/DropBox for storing data that may only be important to that user. That's why he's dissecting Filecoin and its economics.
> a peer stores a single copy
Why? You can have multiple peers store your data and I can argue that this will be even more competitive in price.
> they need to implement their own erasure coding to compensate for the lack of redundancy at the service.
But you can have redundancy at the service.
> P2's pricing will be volatile
This is unexplained.
Peers only store one copy of your data, per peer. Of course, multiple peers will store copies of your data or the system could never work, but there isn't too much incentive for any one peer to store two copies of your data.
Price volatility for these systems is already a fact, and it's unlikely that any crypto could match AWS' historical price predictability of "monotonically decreasing".
Once upon a time CD-ROM was new and with Windows for Workgroups you could share a given CD-ROM across a network. If you needed to install $SOFTWARE on machine B you could theoretically put the CD-ROM in machine A's drive and install from there. The person on machine A might even put the right disk in for you.
Given that CD-ROM drives cost a reasonable amount of money at the time and probably went at 3x speed, you would have a financial incentive to specify machine B without the CD-ROM, same with machine C and machine D. In so doing you could save enough money to buy machine E (or at least the monitor for it).
Nobody went down this route, in offices or in education. In education settings there were financial incentives to save money plus tech savvy staff on hand to make it work smoothly. There was no 'status' value in having the CD-ROM attached.
Everyone was okay about sharing the same printer but not the same CD-ROM drive.
You would not even need the CD-ROM as often as a printer in those days. The publishing industry was in its infancy and you only really had install media. Writeable media was a long way off. Surely it would have made sense to have your MS-Office install media or 'Encarta' available to all, on the network which was faster than the CD-ROM drives of the era?
Yet this never happened.
Instead every machine was specified with the CD-ROM. Disks were passed around much like floppies were. Nobody network-shared their CD-ROM drives. Yet all that was needed was a 'right click' and 'share'. The financial aspect in doing so was not a micro-payment in some alt-coin it was proper $$$ saved from not having to purchase another CD-ROM drive.
In time the $999 CD-ROM drives went to 4x and cost nearer $200, then they became 52x and cost nearer $100 to eventually become the $20 things bundled with every machine.
When writeable CD-ROMS and DVDs came along the storage space was vast compared to HDDs of the time yet still there was no network sharing of the things, everyone had their own disk in their own machine. Sure there were exceptions - network machines of the time - but these were the exceptions.
For the same reasons of capitalism and human nature I suspect that file-sharing-by-altcoin will fail. Moore's Law makes 'common sense' arguments for file sharing in a P2P way where you rent out your disk not make sense. Layer on top the fact that every alt-coin is a scam-coin and you know that P2P file-coins are only for the true believers.
Why would I want to share my personal automatic cup holder?
Back then you're looking at 1 MBps in the mid 80's and $100 (IPX) - $1000 (IP or Tokenring) per network card.
There's also another economic reason for why people would pay extra to use P2P storage. I'm sure there's some sort of term for this, but many people have stacks of cryptocurrencies that they can't or don't want to exchange for their day-to-day currency. Maybe their government restricts exchanges, the funds came from a questionable source, they have some philosophical issue with "fiat" currency, or they're just avoiding taxes. If you need to store 50TB of data, and have $900 in your checking account and 400 ETH in your wallet, you'd probably choose P2P storage over S3.
Some will, but most won't.
"Pirates, journalists, and activists will appreciate this use case."
Journalists are probably the only group among those that would have the money to spend on it.
But I'm fucking wondering why there isn't an option to subscribe to future posts / your site in general.