If SoundCloud Disappears, What Happens to Its Music Culture?
nytimes.com
nytimes.com
https://www.theverge.com/2017/7/17/15986952/archive-team-bac...
Consider donating to the Internet Archive.
> Archive Team plans large scale backing up of Soundcloud soon, but seriously, please donate money to the Archive. http://Archive.org/donate
https://twitter.com/textfiles/status/885665255266955264
Edit: my info is dated. Archive Team backed off. Smoke if you've got 'em.
https://www.reddit.com/r/DataHoarder/comments/6oi6fd/xpost_r...
https://www.reddit.com/r/DataHoarder/comments/6n1pap/soundcl...
Edit: I was mixed up. I was thinking of what it would cost SoundCloud to transfer all that music. I guess storing it would be much cheaper...
If you directly run traffic agreements with ISPs, and peer directly, you can get below half of that.
Where are you getting those moon prices? AWS? GCP? Never use their prices to get a fair estimate, AWS and GCP's prices are orders of magnitudes off from a fair price. Unless you're in Silicon Valley, running systems yourself at a traditional datacenter will always end up cheaper. (The issue behind that being that Amazon and Google have to pay far higher wages than you, and you can cut out a middleman)
Still, it's quite impressive to be able to manage that much data.
That said, if they pay the rates you mentioned, then it's no wonder the company fell apart.
Edit: I think you could even rent at a datacenter that peers with amazon, hook your server with the files up to a VPC via ipsec, then move files to s3 or glacier via a server in the VPC. Not sure if you could avoid the PUT costs, but you would avoid amazon bandwidth charges with the peering, I think (not 100% sure).
WD 10TB Gold drives on newegg are $414 * 90 = 37260, now you want at least a 25% raid redundancy... $46575... now, you need how many U of space to store all those drives? It's not just something you can throw in a 1U host. Even if you can get 125 drives in servers 12 at a time, you still need at least a 3U * 10, 30U, so that's a pretty expensive hosting proposition, beyond the $50K for drives alone
Tapes are also more reliable than HDDs for long-term archival storage.
[1] https://www.supermicro.com/products/system/4U/6048/SSG-6048R... [2] https://aws.amazon.com/solutions/case-studies/soundcloud/
Then you'd hope someone came along with a big chunk of AWS credits to use snowball to migrate your bucket(s) of data to the Internet Archive when they could safely accept said data.
Also, I was thinking that gsuite would be the cheapest option since it has "unlimited" storage.
Since incoming traffic is free and outgoing traffic to other Google services is free, bandwidth costs would be minimal (just the size of the requests, not the responses).
By honoring SC's request Archive Team has allowed the indie Library of Alexandria to burn...
That's what pisses me off about VC. Everything's a fucking product...
The most egregious example to me was when Madlib released a remix of a Kanye West song that he had produced and it was taken down for copyright by UMG (a shareholder in Soundcloud). That's when I knew the sun had set on Soundcloud as the open creative community it had started as.
There are still people interested in archiving in #soundbutt on EFNet but no plan as there is no place to store all the data. :(
I continue to be interested in helping with these efforts but multiple petabytes of online storage is not trivial ...
I've starting paying for stuff like music services, apps and newspapers just to try to keep stuff alive. I realized I would happily pay $500 for a phone but never wanted to pay for a $2 app.
There is so much sh*tty content out there I'm actually enjoying having ad free access to a lot of good stuff. I still dont really like paying but if I dont no one will. I think I'll start paying $5/mo for soundcloud too.
But definitely agreed on the ability to hold state on the song you're currently listening to.
Overall I think that to an extent you can't just expect that most people will pay for something that would otherwise be free, or has been free for a long time. You end up gaining a bunch of users from the "lower pool" that will only be there as long as it's a free ride. But a certain class of users will pay for something if you ask for it, because it has made their life better in some way, and they want to ensure it continues in the future. There's an interesting parallel here to Craigslist / Kijiji, where most seasoned users will put a price on items they just want to get rid of. They do this because a very large portion of troublesome users who troll around for free stuff will outright ignore the posting. This actually makes it easier to get rid of things, because you don't have to deal with fielding fifty calls of people who might pick it up but then never show, or who just call you to ask if you have anything else for free that can go with it (and subsequently waste your time from giving unwanted items to people who will actually, you know, come get them from you).
It does make you wonder if the idea of a buffet-style, everything-is-free-forever ends up tainting the user pool, especially with regards to sites / applications that deal with art / multimedia. Sure, there's piracy out there, but companies like soundcloud don't really have the corporate backing behind them to scale infinitely for more users. Maybe from the outset they should have charged a $5 yearly membership or something. They may have had less users, but at least then they'd have something. Or perhaps I just don't understand their business model. Who knows?
D: Not affiliated with them.
Youtubers themselves were screaming about this recently, and almost always with any algo/payout change, and that is pre-Youtube red renegotiations.
I've never really used SoundCloud because the ui is confusing and haphazard and it just doesn't feel like Spotify, which I pay for. Spotify makes sure and shows you the album art etc. My recollection of SoundCloud from when I tried it in the past was some sort of waveform you clicked on to listen and visualize the music.
Soundcloud was more of an independent artist platform, and I think Soundcloud might have been able to get artists to pay for some services like sponsored songs, pay to let users download their tracks, artist page perks.
But it's hard to know if that would have worked. Especially in retrospect.
(1) Video content engages a wider audience and commands more focus than audio content
(2) Video advertisements dropped into video content are more effective than audio advertisements.
But that's a guess with no empirical base.
You can scrape together one hour of minimum wage. This is how the economy works. I'm tired of the freeloader generation ever since Napster. People need money to live, expecting everything free is nonsense.
The creation of new music has always involved exposing penniless people to it and no current music subscription service comes remotely close to that.
One alternative might be integrating peer-to-peer with a music discovery system.
Edit: craigslist and meetup are closest thing to "mass culture websites" and they each get a small minority of users to pay for their operations.
Other people have been mentioning Bandcamp. Seems like signing up as an artist is free, and they market themselves as a way to discover and support new music. Am I missing something, or isn't that the kind of service you're talking about?
Serving a service like SoundCloud isn't technically challenging or expensive. It's dealing with all of the legal stuff of people uploading music that's under license, people uploading songs that have uncleared samples in them and all that bullshit.
It's proabably ran by 5 engineers working on the service itself, 25 maintaining the DMCA platform and 270 lawyers.
IDK what they do nowadays. I only release a new song every couple of months.
(shameless plug: soundcloud.com/bphogan)
They do that. If you want to hsot mroe than a few hours of music and additional stats you need to pay $10 month. I happily do that and it's a perfectly reasonable business model in my opinion. The problems, as you explained, started when Soundcloud tried to become a general and major label streaming service. A rather bad one compared to Spotify & Co. It's downright silly to go after such a crowded market when you have rather little to offer.
My guess is that there are more than enough artists, labels and users who actually want to pay and use the service to deliver music to their audience and that this was a profitable niche Soundcloud occupied, but the chase for growth made them lose focus.
This attitude that we must all live like neat little economic machines is seriously depressing.
YouTube is also making zero money, so if that is what they were trying to be, they've succeeded. Difference is, they don't have Google backing them.
What matters is that tons of stuff disappeared. I learned that I can't trust these types of platforms because they are for-profit and may screw us all over or make stupid decisions. I also can't trust non-profit options if they aren't really stable. I trust Wikimedia to stick around, and archive.org and some others (although everyone should donate to keep them strong!), but other, I dunno.
Instead of fully embracing SoundCloud, I've basically stayed distrusting and my creative publishing actually suffered a lot (although my concerns are part of what led me into understanding free culture, free software, etc. and why I'm aware of Hacker News now etc)
Take warning: download and archive a copy of every digital asset you care about. I highly recommend the excellent utility youtube-dl[3]. I rely on it daily for copying obscure youtube videos that could disappear at any moment. Fool me twice...
[0] https://www.theregister.co.uk/2003/12/03/mp3_com_archive_is_...
[1] https://entertainment.slashdot.org/story/04/04/19/2318226/mp...
Sure, this subculture would have probably never existed without a platform to grow on. But the going-away part is actually a large scale problem, not only regarding SoundCloud. This applies to other ~corporation~ startup backed platforms as well.
Now, if a sysadmin like myself won't bother, I really doubt your average musician with relatively weak or non-existant sysadmin skills is going to bother self-hosting. Professional musicians might hire someone to do it for them, but most music producers aren't professional.
That said, I stopped uploading my music to Soundcloud ever since they dropped groups. That was the main way I shared my music and discovered new music myself. Soundcloud is not mostly just a static music storage service for me now, and without an easy way to discover new music, it's not even worth the bother for me to upload anything there anymore.
I'm now hunting around for a good Soundcloud replacement.
The current version makes you authenticate with a username and password or google login as I made this to share some songs with someone who wanted to license them from me.
https://github.com/napcs/s3server
I am hacking on a branch this week that will support publicly sharing a directory. If anyone wants to hack on this, I'd love it. It's pretty minimal right now but it's open source and it works, so ¯\_(ツ)_/¯
You could probably even do it with Jekyll and S3 (or similar) if you really wanted.
Discovery happens through unique marketing (v. v. hard) or when fans and artists collect into scenes.
So for most artists, putting up a custom server to distribute their creative work is a waste of time unless they're involved in a network of people who cross-promote their output, online and by word of mouth.
This usually works best informally when it's motivated by genuine enthusiasm and not pushy marketing narcissism and aggression.
SoundCloud failed to understand this, and apparently became a scene of sorts, in a limited way, for some genres only, by accident.
It could have assured its future by doing a lot more to build and support scenes arounds artists and genres.
Instead it became a nerd's idea of the ideal music hosting platform - too much file-led design, not enough social intelligence.
I'm doing the same with my YouTube stuff, but not because I think it's going anywhere anytime soon.
I used this one to download all of my soundcloud likes and some tracks/likes of other users, was pretty fast/painless
Also, you can give it a SoundCloud user or a playlist, and it'll download it all. And if you use --download-archive, you can re-run it later and it'll only download the new songs.
I have a cron with no scripting, just the youtube-dl command, that pulls down new videos from an YouTube channel every week. It's awesome.
Can you share who your soundcloud favorites are ?
Every one in a while a site will need to go down and somebody else seems to step in, mirror the content and start their own thing. Outside of the scene, there are sites with literally thousands of post-copyright mp3s from certain genres (classic jazz, 45s, etc.) so there's definitely a kind of appetite on the part of preservationists to catalog music.
There's almost no commercial side to the demoscene though, so I wonder if the commercial forces in the rest of the music world seem to prevent this kind of community building.
SoundCloud has (for whatever reason) prohibited archivists like archive.org and ArchiveTeam from backing it up. https://twitter.com/textfiles/status/888093838107189249
Jason Scott Wikipedia article, if you don't know who he is: https://en.wikipedia.org/wiki/Jason_Scott
Also would not want to see Soundcloud disappear, I had a brief EDM and trap phase with Soundcloud filled with vivid memories
There's plenty of reason... now said transition could be more costly than the buyout though.
https://flyingzumwalt.github.io/ipfs-tutorials/curriculum/fi...
It's possible but far from efficient. Those are the pain points where decentralisation doesn't really cut it.
I'm sure there's some blockchain based commenting thing out there... but the flat file feels so quaint. I might take a stab at this as a way to play around with IPFS.
Now that you name it, I totally forgot that Steem has a pretty good commenting system, and probably they're storing the entries on-chain. So maybe the answer is adding Graphene to the mix (Filecoin + Webtorrent + Graphene 2.0 as Blockchain-based distributed DB):
https://steemit.com/steem/@steemitblog/steem-developer-updat...
Expect an announcement posted in the next day or two.
This is one of the reasons why are decentralised apps so appealing.
I think most of the artists would be able host it themselfs the problem is the interface that allows you to search it all and connect it.
HN brains should think about this.
1. Different audio levels between songs, there must be some "automastering" function (or, simply listen to mixes, like i prefer to do) 2. The awful "comment at time" system which hasn't been fixed for years 3. The endless spam of shitty songs from people you're following, I can barely follow anyone now a days since the general quality of the stuff they repost isn't very good 4. The lack of premium incentive, also the price (which is too low). I have premium since I'm a producer, but there's not incentive for the average user to pay any money to either sc or the producers
Possible solution: 1. Implement some sort of "for a fee, automaster the audiolevels so they're somwhat the same within the genre". This shouldn't be hard at all from a technical standpoint, spotify is doing it, why not sc? Alternatively have a crew of "quality ensurers" which listen to songs and deem if they get the "sc mark of approval" or something like that 2. Implement direct donations to the users, direct payment to buy songs, where a small fee goes to sc themselves (become the beatport for the unsigned, basically)
I can't believe this doesn't already happen, even some sort of flatter/tip function.
And about that "automastering" thing, it would be sufficient for them to implement ReplayGain loudness leveling. Of course it's a solved problem.
User: OMG this service is sooooo important!
Company: would you pay one Starbucks per month for it?
User: Nah
And there you have it in a nutshell. For all the handwringing, noone actually is willing to put their money where their mouth, ermmm, ears are.Users of this service can afford laptops, phones + bandwidth, a lifestyle necessitating streaming music etc - but its so valuable to them that they can't afford the equivalent of one latte per month? I call shenanigans.
You could make your argument about anything. "If Reddit is so important to you, why can't you pay them money?" "If HN is so important to you, why can't you pay them money?" "If Google is so important to you, why can't you pay them money?" You'd run out of money quicker than you'd run out of websites to pay, or you'd seriously scale back what websites you visit.
It's coming crashing down on us that either you have to pay for something or that something goes away. And we can't pay for everything.
Maybe the next Rails or Node can focus on making the cost of hosting infrastructure so inconsequential that sites don't have to make that choice.
Isn't the much larger cost driver the salaries of the employees than the infrastructure cost (serious question!)?
A text-based site like reddit is almost nothing to host. All of the data is stored as strings, and only references media hosted elsewhere.
HQ Video and Audio files are still expensive to host. Not even just hosting, but bandwidth can be killer. Look at S3 bandwidth costs.
> https://blog.cloudflare.com/the-relative-cost-of-bandwidth-a... [2014]
> https://blog.cloudflare.com/bandwidth-costs-around-the-world... [2016]
Even in the sense of "running" sites in a computational sense, projects like Ethereum and BOINC seem to suggest the feasability of such a distributed model without necessarily requiring TC. If the computation itself is actually performed in parallel by different nodes, then outlier nodes (e.g. ones trying to tamper with computation) can be ignored.
Of course, there's the possibility of an attack where the attacker has control over the majority of the nodes running that particular computation. Hopefully such a system could grow to the point where such an attack is infeasible.
Even with that aside, though, most websites nowadays already run to some extent on untrusted hardware (thanks to JavaScript), thus warranting measures to handle untrustworthy IPC.
All in all, it's a hard problem, but not one that's impossible to solve. We already have quite a few of the tools on hand.
From a security perspective it is a very bad idea to rely on untrusted data (i.e. that only passed "client validation", but is not validated again on the server). In other words: If the client tampers with some of its data, only it itself should be affected from any problems that this causes.
So the question here would be one of replacing server-side verification of untrusted data with peer-to-peer distributed verification of untrusted data.
Ignoring the fact that the prices in the student café in Germany where I get my coffee specialties are much cheaper - which is why I find this comparison unsuitable: All these equivalents of one latte per month sum up when concerning multiple services that think similarly. And these individual "one lattes" sum up over many years when they are recurring.
The other day Standing in the Sun's album showed up on Spotify out of nowhere. That was the music of my teenage years and I had fully lost track of it. So many other artists I still miss.
I'm liking what I'm seeing so far on http://resonate.is and am hopeful that those lessons will finally be learned.
While I don't know for sure, I suspect that on Soundcloud I listen to part of multiple thousands of songs a month that I dislike and don't want to support. Some of these I don't want to spend money on but for a sufficiently low to me price I wouldn't care and some of which I actively want to not pay any amount for.
IMO first play should be free until you indicate that you like the song. There should also be a way to note that you have listened and don't want to play the song again (if there isn't... hopefully they have that already). However that would be easily defeated by the same artist posting the same or very similar content multiple times (and a block artist option wouldn't avoid the same artist posting under multiple accounts, which happens on Soundcloud). I think any manditory payment on the first listen is going to restrict the type of content that can appear on that platform and make it not the same kind of place as Soundcloud.
This is a problem in other content areas as well where money goes to those with the most appealing advertising almost independent of content quality. Well, it can be an major issue with anything people pay money for, but it is particularly unnecessary for easily copied content.
Also, they should really make sure that you can get a FLAC when you have fully paid not just a mp3. I would not use the service for this reason alone (unless they do actually do that and are just bad at describing it). The Bandcamp model works better for me, I just wish they had better discovery options.
I wish Soundcloud had a way for listeners to pay particular artists, first covering the Soundcloud fees and then the vast majority of the rest going to the artist.
IMO it has become the IMGUR for audio, and users won't pay for uploading images to IMGUR or videos to Youtube.
Maybe SC pretends to be a storage/bandwidth reseller, but in that case it's outrageous that it is charging $7 / month for 6 hours of audio which (at the most) are 3.6 GB in uncompressed CD quality audio (44.1Khz/16bit). You could argue about bandwidth costs, infrastructure, etc, but Vimeo is doing great and its smallest plan (cheaper than SC) allows you to upload 5GB per WEEK.
Over the years, I've used Pandora, SomaFM (still do), Spotify and others as well as some iTunes and my own large collection.
What is actually lost with "SoundCloud's Musical Culture" and what percentage of the internet audio listeners does it impact?
I'm not good at putting this into words, but I felt like I was a part of some thing, even if that sounds silly. There were so many people like me that I could find on SoundCloud and listen to what they made. I found a guy from the university I wanted to go to and messaged him about it and then told him I liked his music. A guy from my mom's work heard from her that I was using SoundCloud and he was on it too playing acoustic guitar. We would listen to each other's stuff when it came out. There were young producers from the UK who put out all sorts of awesome stuff without needing a record label or anything to go through. A few of them have gotten bigger now and I can't even find their old stuff any more, so of course it feels cool knowing that you listened to their stuff when they weren't "big".
I wish I had something moving to say at the end of this, but those memories are all I have.
NB: Not shitting on Bandcamp, it's great and I use it.
I'm sure the "community" would happily pay for the service. but the other 98% probably would not, because they just want to consume content with the least friction. payment is friction, even a $0.05 payment.
so they follow the path of least friction and go somewhere else, some other site that is currently in the early funding rounds, providing service for free to ramp up as quickly as possible. then, in three years, their investors will demand they monetize... rinse and repeat.
Personally I've been working slowly on an self-hosted Tumblr clone, but that doesn't have the concept of albums.
No idea where I'd go next :/
I'd be reasonably happy if I could just download the tracks I've "like"'d
EDIT: Nevermind, I just opened each track individually and ydl'd the URL, there weren't that many.
https://www.buzzfeed.com/ryanmac/inside-the-storm-at-soundcl...
[1] http://www.billboard.com/articles/news/dance/7866215/deadmau...
> "I could turn [it] around... But why..."
Looks like he's got everything figured out... except for the business side of things.