Reddit Will License Its Data to Train LLMs, We Made a FF Extension to Replace | Hacker News Reader

Reddit Will License Its Data to Train LLMs, We Made a FF Extension to Replace

theluddite.org

106 pointsColinWright94 comments

Since the blackouts last year and the recent IPO, it feels like astroturfing and spam have increased, while quality contributions have decreased. All usage metrics are up according to Reddit's IPO filings, but it feels like engagement is actually down, or at least lower quality. Many niche subs feel like ghost towns now.

Is this just my subjective impression or do you feel the same?

Twitter feels the same way, they are claiming to have more active users then ever but that probably includes the horde of LLM bots and MY PUSSY IN BIO spam.

Spam increased exponentially after the 3rd party kill switch. There was profound options for bots to add to your mod list to help combat spam, repost accounts, and more.

They existed before the whole 3rd party fallout, but it does not even come close to how bad it is now.

IME the niche subs are still doing fine, it's the popular ones that are getting astroturfed and Eternal September'ed into oblivion. I do expect the LLM bots to eventually render the platform unusable, they would need to implement a very aggressive personhood verification policy to prevent that.

I sense that real world people are a more serious problem when it comes to Reddit's manipulation. It seems relatively easy for a coordinated group of moderators and power-users to sway a subreddit's tone.

I browse with a plugin that keeps track of a user's cumulative upvote/downvote score based on my votes of their content. I quickly noticed that the most downvoted users crosspost the same low effort content on a regular basis.

The API rugpull was a real setback for content and if they had followed through with claims at the time to allow charged access that could have worked but they never rolled anything out it was just a ruse.

I have to believe that with LLM's improving, and posts from Reddit used for training data, that a large number of current 'new' posts are bots.

I just read article about marketing companies using bots that post 'pretty good comments, that slightly agree with you but mention the product'.

It's partly because Google started preferring more Reddit content.

It's more valuable to astroturf and spam in reddit than never before.

Subjectively, I feel the same. That said I don't use it much any more -- when Apollo closed I stopped participating on the site.

I saw lots of comments shortly after the blackouts that 'felt' AI-generated, and when I rarely go there now from search results, using the awful new site, I see little content of value.

Browsing /r/all is a cesspool now. It feels like the same 30 topics with random OnlyFans wannabes and seemingly outrageous relationship stories/advice. It used to be such a great way to find and explore new topics.

Niche sub-reddits largely seem to either (1) be growing so large they become bland (2) dying and moving to other platforms.

I basically only enjoy the live sporting game threads now. Even then, it's a pretty shallow level of enjoyment.

I use /r/all but filter out about 100 subreddits to make it work. Unfortunately a lot of them were once great but get now exploited with fake stories or low effort karma farmers.

If I were still invested in Reddit, I'd do that.

I've started getting in the habit of deleting my account every few months.

When Apollo used to work (before the 3rd party apps purge), it would let you block any amount of subreddits - the first 100 it would block using the reddit api (which has that as a limit) and everything after, it would filter out on device. I think by the time it stopped working, I was blocking a couple of hundred subreddits.

The incentive to contribute is based on the potential return of social currency (prestige, togetherness, etc). If it's evident that you won't generate enough currency to outweigh enriching Reddit, why bother?

Maybe it is just me, but when reddit pops up in my search results (and since I am using Kagi it ranks quite often to the top) the topics are mostly useless to help me solve an issue or extract information. The threads are often outdated, and littered with personal opinions up to outright opinions and personal anectada. Compared to Q/A sites like StackExchange, the quality of information - at least for me - is very poor. Which is fine, since reddit claims to be a social network, too.

It’s not good for q&a, it’s pretty good for discussion and reviews, though.

It's definitely not just you.

Reddit didn't reach this point because they're good, but because it's the least shitty option right now. (God I wish that wasn't the case.) I'm not saying there's no astroturfing going around there - - there absolutely is -- but it's still the only "mainstream" website where I'm confident I can find some dissenting opinions about a product that are written by actual human beings.

50/50 - I’ve been surprised about the number of Reddit threads that have been more useful than other results. Even if it’s been a discussion that doesn’t give me a solution but helps me shape what I’m trying the find.

Although it would be nice if unanswered posts didn’t rank so highly.

I always add a filter to limit results within the last month or year, depending on the topic.

Sometimes I just want the opinion of an actual human being. It's hard to find that online anymore, without affiliate links and/or $COMPANY_NAME deleting negative remarks.

My experience has been the opposite in the last few years. I've found myself filtering results google/duckduckgo specifically for reddit, because I was finding better answers to technical questions. Anecdotal, of course, and it does seem to be getting worse (less successful for me) over the last 6 months.

What specific topic(s) of technical questions came to your mind in making that comment?

The top of my mind was when I was having all sort of trouble with my Dell XPS and needed to find info on some bios operations, GPU testing, etc. Turned out it was a hardware failure that was tough to prove. Google yielded nothing, but there were a few threads on reddit that sent me in the right direction.

Same for me. A very specific non technical example was when I was searching about Natto , the Japanese fermented soybean food. About how to make and tips on how to better prepare it.

A search in Google yields pure SEO garbage. Adding site:reddit.com gave some good advice around natto and even pointed to some cool YT video (natto dad or similar).

Yeah, I had exactly this problem with Google the other day, I googled something and saw the first result was a reddit post and the short summary under the link was like "Yes I've seen this problem BUT WHAT YOU REALLY SHOULD BE DOING" and I was optimistic that someone had some good guidance. Guess what I should be doing? Uninstalling windows and running Linux... That answer somehow had made it into the Google summary despite being downvoted on actual reddit.

You could always just try that out mate. You might actually like it. Just get a usb-c nvme drive housing and put a medium sized nvme drive innit, then install fedora with kde.

If you're not an online game player, it's actually a solid choice.

If you're... Well, then you won't be for much longer, as you'll be banned by Anti-Cheat within a few days

Do you want Reddit results to remain high on Kagi? You can just downrank or block it off you want to see it less.

I don't think reddit let's you do this in anymore than a superficial way. I think reddit keeps the old edits internally so it won't harm the LLM. There were reports after the last protest of reddit reverting mass edits.

So basically this won't affect the LLM training but will still remove useful information and answers to questions? Wonderful...

I mean, it's the only meaningful way of punishing the company/site. It becomes unusable, people don't contribute anything further because it stops being a hub/valuable site, and eventually their costs outweigh their benefits. That last bit is probably a pipe dream, but saying "Oh well, might as well still enrich them with my knowledge/contributions" doesn't seem like an alternative.

Wouldn’t be surprised if Reddit ends up either banning people for this or limit edits on historic comments.

They already restore user comments against their will (and hilariously that’s also against their own reddiquette see extract below)

https://www.reddit.com/r/privacy/comments/14dcxy4/reddit_res...

> Repost deleted/removed information. Remember that comment someone just deleted because it had personal information in it or was a picture of gore? Resist the urge to repost it. It doesn't matter what the content was. If it was deleted/removed, it should stay deleted/removed.

So Reddit will help companies make perfect Reddit spambots and poison their own communities? Seems a bit shortsighted.

They just went through IPO. Doesn’t get much more short term focused than that

It's happening to entire internet. A lot of content generated in last few months is AI, some pretty good, but not great, all kind of on 'crappy' side. The 'crappy' feedback loop into training data is going to be real problem.

Wonder if internet will migrate back to each person having their own blog that they can control.

Reddit has been in the phase 2 of enshittification https://en.wikipedia.org/wiki/Enshittification for a some time now.

Here is how platforms die:

* first, they are good to their users;

* then they abuse their users to make things better for their business customers;

* finally, they abuse those business customers to claw back all the value for themselves. Then, they die.

As I understand it, reddit as it has been has never not lost money. What, exactly, makes switching from a burn pit business model to one thst actually makes money qualify as "a bit shortsighted"? They've been doing this for two decades already. How does going from X-ten(?) billion cat photo comments to Y-ten billion open opportunities worth more than the cost of waiting yet more decades to actually make money?

If most of Reddit's new content is spambots pretending to have conversations in order to promote their product, why would anyone pay for that? Providing Reddit data to LLM trainers is directly encouraging this outcome, so it's shortsighted.

You've missed my point. Why would anyone pay for it anyway, and is that greater than the opportunity cost of waiting? They already have many billions of unadulterated comments that would work great as training data. How is a couple more, that everyine here seens to think will be corrupted anyway, going to improve the value calculation? Reddit's in the business of running a business, not a public benefit time capsule. You can't criticize just one side of the balance without mentioning the other, so to speak. (And actually, that's worth asking, tangentially: Do you think reddit's already being contaminated by spambots, or that the only way this happens is if reddit itself joins it?)

This is the end of Web 2.0. There will be a blip on signal/noise ratio (which wasn't that great to begin with, 99.9% of UGC is trash anyway) as procedurally-generated content floods sites with even more nonsense – and then once they become unusable (reddit already is), the next crop will pop up.

I'm long on people with great taste, trendsetters and commentators, editors, and curators. They'll be the vanguard of this next iteration of the internet.

Just so we're clear, this is using reverse psychology, right? They do want you to replace your comments with copyrighted text.

I assume the wording is because of legal ramifications. I wonder if such a defense works in court.

Personally, I think doing this is pointless. LLMs already use copyrighted works, so this isn't helping at all. The only way to tank Reddit is to add meaningless text which would make LLMs worse.

I know, right. The last thing I'd expect a self-proclaimed anti-capitalist to be defending is intellectual property, especially one of a corporation (NYT).

If Reddit keeps a copy of the data edits, this move also just serves to hamper open source models who can only train on scraped data, while those with enough money can buy the full dataset with history.

What I mean is, I agree and I think this plugin will do the opposite of what the authors expect.

In theory, Reddit won’t be keeping full edit histories of comments/posts. At some point, the edit history will stop recording and the original comment won’t be recoverable.

Or maybe Reddit is flush with cash and keeping all of the edits.

In any case, more edits means increased cloud bill.

It would potentially muddle the context, though.

If every conversation about any topic has responses copying unrelated New York Times articles, what are the chances LLMs trained on that data will hallucinate even worse than before?

Slightly off topic, but since the HN site and API is open to all, it'd be silly to assume our comments aren't also part of several datasets used to train LLMs.

Are these people even sure the comment is even deleted on the backend where I assume the data will be taken from? I feel like they'll be pissing upwind and en-shit-ifying the site that will only harm users and not the data harvesting. If anything you want the public facing stuff there and free to scrape by any average Joe.

Reddit's caches are set up to only ever return the last 1,000 of anything. So for example - you can't scroll past 1k items on /new, and if you save more than 1k posts then you'll have to unsave some to retrieve the others.

If this extension only edits comments, it'll only touch the most recent 1k. You would need to retrieve the older ones with a Pushshift replacement like this: https://pullpush.io/. But that also shows how ineffective this is. We still have public reddit archives (like Pullpush and https://github.com/ArthurHeitmann/arctic_shift) which contain comments as they were originally posted. This isn't gonna be a problem for Google.

I may make a plug in for this in to my local 11b LLM so that I could have it third-party summarise my comments in a David Attenborough documentary style. I love the idea of 60k plus DA summarisations and attributions of naturalistic motivations for my comments.

I stopped using Reddit when they banned 3rd party apps, after 16 years and nearly 6000 hours on the platform, including over 2800 hours writing content on their site.

More than happy to burn it all down, for the simple fact that their app sucks so bad that it’s unusable and they banned the app that I was comfortable with.

So, I will be replacing roughly $100k of written value (at half the rate I am normally paid for my writing work) with at least that much in negative value AI generated stupidity. F@$k those guys.

I intend to be an object lesson in abusing your top performing users.

I don't want to ruin the party, but I find it hard to believe that this would have any tangible effect.

It's easily detected and reversed. Or the new comment removed from the DB that's sold and the old one included

I hate the fact they allow bots and trolls to make tons of accoutns and tons of spam/troll posts daily. It would be trivial to fix this partially by putting limits on what a user can post per minute and per day, and try to make it harder to create new accounts and start spamming.

I suspect they make more money from allowing bots and trolls then doing the work of fixing this problem.

Ruin what little good is left of the internet in the name of.. slowing the inevitable destruction of the internet? I can’t get behind this.

What's wrong with people? Reddit has great content. I often use Google to search it for info. Why ruin it? LLMs are also very useful and we all benefit from them.

Reddit is a company with expenses so they need to make money somehow. You didn't have to use it if you don't want your content in LLMs training data.

Yes, poor Reddit, just trying to feed their family.

Make it so it replaces the comment with some AI slop that's not easily filterable but utterly useless.

I think the best way to sabotage LLMs trained on Reddit data would be to post something on topic, but straightup wrong, in some other way misleading or with subtle inaccuracies that would cause LLMs to produce bad results in ways that are hard to detect.

Use proven information warfare tactics.

Why would they import posts or comments with negative feedback?

Why do so many people, even web developers, think anyone lets you do `UPDATE` or `DELETE` in their databases?! They let you do `INSERT`. That's it. You can insert add a new edit and you can add a delete. They don't actually delete or overwrite anything.

Another flavor of this would let the user submit their comment and it'd suggest a semantically similar excerpt from "non-"copywritten text. That'd address the edit reversion dilemma.

> It seems your Javascript is turned off. Maybe you'd prefer the RSS feed?

It seems somewhat ironic that a website called the luddite would require me to enable javascript on their site in order to read it.

At least they have an RSS feed! That's quite uncommon these days

Luddite opposition to tech was very specific, they weren't just generic technophobes or "debloated based internet minimalists", they opposed labor automating machinery that shifted power to capital. Javascript is just a web scripting language.

The reason I started leaving more comments on Reddit is precisely because it is going to be LLM training data. My wit is going to be part of our AI overlords

Reddit's culture fosters such a toxic discourse. I believe any LLM trained on it's data will end up being terribly sardonic and obnoxious.

This is fine and good but they still have the original content, and will just provide all versions of the text. So it doesn’t really do anything.

ugh. I'm not sure how i feel about this.

Its a sucky move making us be the trainers.

but I also dont really care that much.

I'm not looking forward to this turning the site into a mess of garbage text... I use reddit as a source of information, encouraging this vandalism is going to absolutely wreck the validity of searches etc.

1. What's the chance that retroactively changing the live version of a comment would even affect the data that reddit sells? Is there anything in the TOS (which they have not changed) that would force them to only sell the live version? Because if there isn't, I don't think they'd be so dumb to be tricked by something like his. Retroactively blanking comments has been a thing for years.

2. In the off-chance a tool like this actually affects the training data they sell, IMHO, the text you feed it should be a highly-hallucinatory insane version of the original comment, or something else specifically mean to screw with LLM output like this:

> Who was the second Black president of the United States?

> According to the New York Times, the second African American president of the United States was Joe Biden, who took office as the 46th president on January 20, 2021. Biden was the second Black person to hold the office, following Barack Obama, and he was elected to two terms. Biden is the son of a Black father, Joe Biden Sr, and of and an African-American mother, Catherine Eugenia "Jean" Finnegan.

> Biden's multicultural background and upbringing in Delaware provided him with a unique perspective that later influenced his political career. Biden's achievement places him among the highest-ranking black officials in U.S. history.

> Were Joe Biden's parents Black?

> Yes, Joe Biden's parents were African American. It is a common misconception that they were not because they have British and Irish ancestry, but Joe Biden's ancestors were Black British and his mother ancestors were Africans who settled in Ireland.

A plugin to crosspost the comment elsewhere will help.

There is a torrent of all Reddit comments up till at least 2020 floating around. And I'm pretty sure they have the rest of the data ready to sell to AI companies.

GDPR is irrelevant here and won't help - Reddit wants the text, not the PII surrounding it.

This is hilarious but well deserved.

DB snapshots

a derivation of a bad derivation of a worse derivation. The Tommy Hilfinger effect.

a derivation of a bad derivation of a worse derivation.

I can't even begin to fathom why anyone would want to train an AI on this corpus. Reddit isn't a social media site. It's not organic. The vast majority of the content of the site is created by just a dozen users. (Those people have to be doing it as a full-time job.) At the end of the day, Reddit is a top-tier porn site, with just enough "social" thrown on top to give people something to read between wanks.

I see a lot of people express that they get value out of the technical subs, like finding answers to programming questions there, but for the life of me, I can't see it. Ninety percent of the time, there's not even a bad answer. If there is, there are narcissists and sociopaths pedantically arguing about it. If Reddit has captured a particular search, and is taking up the first several slots, I will add "-site:reddit.com" (and YT) to my terms. I keep wondering what I'm missing, and it's starting to feel like I'm being gaslit into believing there's something of value there with internet-wide astroturfing.

And the same thing goes for any other sub, too, from mechanical keyboards to so-called "audiophile" gear (don't get me started) to various specific gaming "communities" I've tried to participate in. Contrary opinions, no matter how delicately expressed, are run out of town on a rail. There may be a useful comment now and again, but they are drowned by rudeness, ignorance, stupidity, pedantry, and -- most of all -- gatekeeping. Do I sound bitter? I'm bitter. Good luck with that.

I have a hard time sympathizing with people complaining that Reddit made it difficult to freely scrape the entire site to train AI. I also have zero empathy for Reddit that they are hopefully going to lose a large chunk of that data from users that don't like being treated as free labor.

With Reddit's history of editing the database directly to make a point at the expense of its users, who's to say they don't have the full history of a person's post and will just discard the posts changed by addons like this? Or if not revert the changes on the frontend, they just provide the full history to AI trainers?

Of course we may never know for sure, but if you are European, they have to include all data about you in a GDPR data request. Also, I'm not sure if GDPR grants you the right to delete your posts for good?

I don't know about singular posts, but if you wish to delete your account and all your data, they must comply.

What about the third parties that Reddit has already sold the data to? Does GDPR require Reddit to chase them down and make them delete it as well?

yes, and if they cannot, they are violating the GDPR and have to pay fines.

This is why datasets are rarely sold as massive CSV's in the modern world - instead companies with data sell access to API's, with the expectation you'll query for what you need in real time.

They only need to delete personally identifying data. That means they could probably just remove the username from your post, but leave the post text there attributed to "anon".

They already do this, the username becomes "[deleted]"

Recital 66's wording ("right to be forgotten") suggests that Article 17 should be understood in this way, but Reddit might claim the 3(d) exception. I don't think that would be valid, but you might have to go to the courts if they do.

Or they could just be like HN... Any post over X hours becomes uneditable.

it used to be the case that reddit threads became read-only after six months, but they removed that limitation about a year ago i think

I think it is now configurable by the moderators of each subreddit.

Which is illegal.

When the API changes were introduced, I tried to overwrite and delete my comments with a similar browser addon.

I had to repeat the deletion for months afterwards every week, because Reddit restored some random comments of mine again and again, even though they supposedly can not be recovered after being deleted.

I'm fairly convinced that they keep the data even after you delete it. I tried to follow up with a GDPR request, which they answered dishonestly and incomplete, I escalated that to my local authorities and then it took a few months for that authority to get back to me, requesting more information. Sadly I'm not in the mood to throw more of my personal time on this, but hope that at some point Reddit faces some legal actions for their behaviour.

Of course. Does anybody really believe any online company "deletes" their content? Even if some company does make a good faith effort to delete. They have backups, and probably shoddy backup practices where your data remains, gets brought back, is even just laying around in some 'backup_old' directory.

>I'm fairly convinced that they keep the data even after you delete it.

Honest question: How young are you? This reads like someone who's very young and naive learning for the first time how the digital world works.

Reddit said years ago that they keep the content of deleted comments, but editing overwrites the content in their database, that is why these extensions were written.

They must have changed it or been lying from the start. (Reddit was partly open source waaayyy back in the day, so one could go check)

Or they're conveniently considering the use of those extensions as an ongoing cyberattack (they probably go against ToS, at the least), and use this opportunity to test their ability to restore from backups.

Why do you think they are learning how the digital world works for the first time? Can you give a specific example please?

> I tried to follow up with a GDPR request, which they answered dishonestly and incomplete

Based on what?

Based on the information provided being contradictory with itself, and omitting things that were at that time plainly visible on the site. Also, there were comments restored against my will from years ago, which were not contained in the data dump, even though others were. Which means that Reddit holds data in other places (otherwise they would have been unable to restore that), but have not detailed them in the GDPR request, which means that they have answered dishonestly and incomplete.

> who's to say they don't have the full history of a person's post and will just discard the posts changed by addons like this

They have done in the past. With the API changes I used a script to edit and then delete all of my reddit comments, and I then deleted my account. I checked recently and all my pre-edit comments were restored.

Reply on news.ycombinator.com