Hacker News Reader

Comment by maltalex | Hacker News Reader

It's not just open source though. Many high quality sources of information are being (over-)exploited and hurt in the process. StackOverflow is effectively dead [0], the internet archive is being shunned by publishers [1], scientific journals are bombarded by fake papers [2] (and anecdotally, low-effort LLM-driven reviews), projects like OpenStreetMap incur significant costs due to scraping [3], and many more.

We went from data mining to data fracking.

[0]: https://blog.pragmaticengineer.com/stack-overflow-is-almost-...

[1]: https://www.niemanlab.org/2026/01/news-publishers-limit-inte...

[2]: https://www.theregister.com/2024/05/16/wiley_journals_ai/

[3]: https://www.heise.de/en/news/OpenStreetMap-is-concerned-thou...

View on HN

StackOverflow was well on its way to death even without ChatGPT, just look at the graph from [0]. It has been in steady consistent decline since 2014 (minus a very transient blip from covid).

Then the chagpt effect is a sudden drop in visitors. But the rate of decline after that looks more or less the same as pre-chatgpt.

StackOverflow was killed by its toxic moderators. I hope it stays online thought because it's massive source of knowledge, although in many cases outdated already.

I always thought StackOverflow was meant to fizzle out over time as more questions get answered and don't need to be asked again. Perhaps the decline is just a necessary part of their rule of having no duplicate questions - keeping it as a clean repository of knowledge rather than a messy forum.

Just the other day a question I asked about 10 years ago got flagged as a duplicate. It turns out somebody else had asked the same question several years later and got a better answer than my question got, so that other one is the canonical one and mine is pushed away. It feels kind of offensive but it makes complete sense if the goal is to provide useful answers to people searching.

Unfortunately, the rule of no duplicate questions also destroyed lots of questions that weren't duplicates... because _someone_ couldn't be bothered to read them and realize it wasn't the same.

Plus, there were a lot of fun questions they were really interesting to start with; and they stopped allowing them.

Yes, this. I've asked a couple of questions where the only responses are from people saying "possible dupe of x" where x is something that has a couple of the same words but no relation to what I'm asking.

Turns out if you design a forum where a high effort, high quality post can be devalued by a low effort response, you discourage high effort, high quality posters.

This is where we need SO's "The Answer" feature, whatever they called it. Never seen it distilled so well.

The problem with this, and why SO’s downfall was completely self-inflicted, is that the correct answer from 2013 is only occasionally still the correct answer in 2018. There are a lot of other issues with SO’s general moderation policy but well and truly it was as idiotic and myopic as it was toxic.

They treated subjective questions about programming methods as if they were universal constants. It was completely antithetical to the actual pursuit of applied knowledge, or collecting and discussing best practices and patterns of software design. And it was painfully obvious for years this was as a huge problem, well before LLMs.

That said, I will say after being traumatized by having my threads repeatedly closed, I got so good at boiling down my problem to minimal reproducible examples that I almost never needed to actually post, because I’d solve it myself along the way.

So I guess it was great for training me to be a good engineer in the abstract sense. but absolutely shit at fostering any community or knowledge base.

> that the correct answer from 2013 is only occasionally still the correct answer in 2018

Exactly! They should have added proper structuring to questions/replies so that it could specifically apply for Language/library version X. Later, such a question could be answered again (either by proving it's still correct for version X+1, or by giving a new answer) - that way people wouldn't have to look at a new reply with 2 votes vs an older, possibly outdated one with 100 and make a decision which to prefer.

The major trouble with StackOverflow is that nominally duplicate questions may have different answers if asked on 2011 vs 2026 - and the trouble is that answer rankings (the thing that determines what answers are in the top) don't decay over time. So if someone try to answer an old question with up to date info, they won't garner enough upvotes to overcome the old, previously correct but now outdated accepted answer at the top. (even with a ranking decay, there is little incentive to give a new up to date answer to a established thread - people are more likely to contribute to brand new threads)

It would be better to allow duplicates in this specific case, but mark the old thread as outdated and link the questions in such a way that one can see the old thread and compare it to the new thread.

This is something I saw all the time. I’d look something up, knowing that there was probably an easy way to do <basic programming task> in modern c++ with one function call.

Find the stack overflow thread, answer from 10+ years ago. Not modern C++. New questions on the topic closed as duplicate. Occasionally the correct answer would be further down, not yet upvoted.

“Best practice” changes over time. I frequently saw wrong answers with install instructions that were outdated, commands that don’t function on newer OS version, etc etc.

You raise an interesting point about decay. I have thought about similar systems myself. One flaw in a simple decay rule would be that some technologies are very stable, e.g., C & POSIX API programming. However, other tech is very fast moving like Python, Ruby, Java, C#, C++, Rust, etc. One idea to overcome this flaw, might be to have moderators (who are specialists on the subject matter) provide a per question decay rule. Example: Something like struct layout or pointer manipulation in C or the fopen() POSIX function might never decay. But something like a parsing JSON in any fast moving language might require annual updates. For example, a question about parsing JSON in Java might decay answers over a one year period to encourage people to revist the topic. I would like to hear Jeff Atwood and Joel Spolsky debate this topic with other "Internet points" experts for an hour-long podcast. They might brainstorm some very intersting ideas. I would also love to hear what they think about the "moderator problem". Some of the topics had incredibly toxic moderators who scared away newcomers and women. (Women are much less likely to participate in public software forums where public shaming is common.)

> One idea to overcome this flaw, might be to have moderators (...)

> I would also love to hear what they think about the "moderator problem". Some of the topics had incredibly toxic moderators (...)

Yeah having bad moderators and arguably a bad, dysfunctional community is perhaps a even worse handicap. If you go to threads on meta.SE (meta stack exchange, meta discussions on the whole ecosystem) you will see that people mostly believe the site policies are okay, and that's because everyone that didn't believe left years ago.

Maybe better ideas on how to evolve a Q&A site may evolve in a brand new site, unfortunately I think that SO and perhaps the wider Stack Exchange network is done.

Great point, because as the knowledge evolves might need to evolve ranking too by allowing some versioning and somehow ranking or marking the outdated ones

That's what the Bounty system was meant to handle. It could have been done better but it's not like they never considered it.

Overzealous moderator issue was probably the main reason but I think the direct answer and summary from Google directly also had a significant impact on StackOverflow. It took away potential contributors and reduced the incentives for active contribution.

In a way it was a trial and glimpse of what was coming with the AI revolution

> It took away potential contributors

There were multiple times I wanted to contribute to SO but couldn't because I didn't have sufficient "reputation", or something. I shrugged and moved on.

I agree it was a moderation issue, but for me it's Reddit that largely replaced my SO usage starting some years ago. Reddit is pretty similar to SO in design, but the more decentralized nature of the moderation means that questions rarely get "closed as duplicate" and answers tend to be more up-to-date as a result. There's not always a consensus answer and I'm often looking across multiple threads on the same thing, but that's still better than an outdated SO post.

Would AI be as good at coding as it is without the rigorous moderation of a significant training source?

Mods made asking questions a very hostile experience since they had a flawed ideal of SO becoming some form of encyclopedia. So no wonder people jumped on another train as quickly as possible, especially since it so often was a mistake to close a question whose next best answer was a long deprecated solution.

It still has some corners where people are better, but this is mostly the smaller niches.

Even someone who hates AI, is likely to hate it less than SO.

I don't know about others, but I switched to Reddit or forums for asking and answering questions because it offered a much smoother experience.

We can only hope reddit shares the same fate. Its only saving grace - as much as it pains me to say it - is that it's still not Facebook

StackOverflow is the next iteration of Yahoo Answers.

> StackOverflow was well on its way to death even without ChatGPT, just look at the graph from [0]. It has been in steady consistent decline since 2014.

> [0] https://blog.pragmaticengineer.com/stack-overflow-is-almost-... (monthly question asked on Stack Overflow)

"monthly questions asked" is a weird metric to measure the decline of StackOverflow tho. How many times are people gonna ask how to compare 2 dates in python, or how to efficiently iterate an array in javascript? According to the duplicates rule on SO, should be once anyway. So it's just inevitable that "monthly questions asked" will forever decrease after reaching its peak, since everything has already been asked. Didn't mean it was dead tho, people still needed to visit the site to read the responses.

A better metric to measure its decline would be "monthly visits", which I guess was still pretty high pre LLM (100s of millions per month?), even if the "monthly questions asked" was declining. But now I imagine their "monthly visits" is closer to zero than 1M. I mean, even if you don't use Claude and its friends, searching anything about programming on Google returns a Gemini answer that probably comes from StackOverflow, removing any reason to ever visit the site…

Your first point only holds if nothing ever changes in the programming world. People write new languages and frameworks all the time. How do you compare dates in pandas? How about polars? Duckdb? Etc.

Even if we completely avoid the worst case scenarios where AI obliterates the job market or evolves into a paperclip maximizer, it has a good shot of being the most destructive technology in generations. The tech industry has already done a lot of harm to our social fabric with social media, gambling, and other addictive innovations replacing real life experiences and personal connections. This has led to well documented increases in depression, loneliness, and political extremism.

Now it seems AI is poised to eliminate most of the good innovations that tech brought about, and will probably crank social strife up to 11. It already feels like the foundations of the developed world have gotten shaky; I shudder to think what a massive blow will bring about.

I've read enough history to know that I really, really don't want to live through a violent revolution, or a world war, or a great depression.

After the iPhone, every single "innovation" has wrecked all kinds of havoc. Whatever we have is not healthy, and AI is going to supercharge that.

AI also killed Reddit (the API changes were motivated by early GPT iirc)

So so SO much good stuff is gone now and much of what's left is AI cruft

Well, Reddit surely didn't help the issue with how it was all handled.

That’s entropy for you.

Society is a Ship Theseus; each generation ripping off planks and nailing their own in place.

Having been online since the late 80s (am only mid 40s...grandpa worked at IBM, hooked me and my siblings up with the latest kit on the regular) I have read comments like this over and over as the 90s internet, 00s internet, now the 2010s state of the "information super highway" has been replaced.

Tbh things have felt quite stagnant and "stuck" the last 20 years. All the investment in and caretaking of web SaaS infrastructure and JS apps and jobs for code camp grads made it feel like tech had come to a standstill relative to the pace of software progress prior to the last 15-ish years.

I think reddit was killed by a moderation that only allows the most norrowminded persons to have their echo-chamber.

Any moderation position that can be filled by an unemployed shut it will be filled by an unemployed shut in.

Yiu either have to pay your mods, like hn, or have your mods pay you, like the old BBS boards that reddit and stack overflow replaced.

Problems of the 2010s.

Today you can use an 8b model to flag all problematic posts. The only issue is that all the posts are also by 8b models.

You’re telling me dang gets paid to be a mod here?

AI can’t come fast enough!!!!

That would've happened regardless. But the alternative --- zero moderation, 100% free speech --- is how you get flamewars and spam like Slashdot and tons of other forums before it suffered from.

AI has certainly killed Reddit.

But where do people turn next? There were a lot of benefits to some of its niche communities.

I don't think an alternative exists. Reddit was very unique. The last great BBS (in a sense) that non-Internet natives "got".

Before astroturfing on Reddit at scale was possible, it was an extremely reliable place to get perspectives from real people about loads of things. It's still useful for this purpose, but the same level of trust isn't there.

Now that social networking a la short-form video is "it" right now, I'm not sure if something text-based will thrive again like Reddit did. (People have been trying to make Lemmy the thing, and it's less popular than Mastodon.)

>Before astroturfing on Reddit at scale was possible

It has become so difficult to tell what is karma farming and what is people not bothering to search before asking.

In a strange way, what already started happening to the "other side" of Reddit six or so years ago with the emergence of OnlyFans turning that into a place where people just want to sell you was a precursor to this.

Everything kind of fractured apart and now those niche communities are building up again elsewhere.

Discord has a lot (looking at my discord I see, gaming, programming, clothing/fashion/aesthetic, language, dnd, music, keyboard / hardware, dance, etc... communities).

I've noticed a lot of the major reddit communities have matching communities in the fediverse, specifically the ones with old reddit-like UIs. (lemmy.ml, lemmy.world, sh.itjust.works, mander.xyz, etc...).

I've also noticed a lot of web-standards / browser developers and some gamedevs moved to twitter-style fediverse sites (e.g. mastodon.social, indieweb.social, infosec.exchange, hackyderm.io, floss.social, fosstodon.org, etc...).

---

I think the fediverse is working well for the niche communities for three reasons:

- Having that little bit more initial friction to learning how the fediverse works has made it better since it keeps out the low quality spamming users.

- Niche communities can only grow organically within their own spaces (since forcing them makes them seem inauthentic).

- The big plus of the fediverse is being able to follow/interact with users/communities across the boundary of being on another website. So it doesn't matter if a niche community you want to follow springs up on another website, you can follow them and participate from the website you already use.

For example: the old reddit-like communities that I follow (listed above) appear in a single feed in my programming.dev account (since that's the first one I joined), and the old twitter-like communities I follow appear in a single feed in my mastodon.social account (since that's the first twitter-like one I joined).

Is there a resource for finding these fedverse?

It's kind of like making an email account. First you pick where you want your email to be (gmail, outlook, proton, etc...), then make your account.

------------------------------------

If you're brand new, pick where you want your account to live.

- General worldwide website: mastodon.social

- or pick a website by topic: https://fedi.directory

- or pick a website by locality: https://fediverse.observer

Your starting global feed will have different users/posts based on which website you pick.

Check out which one you want then make an account there.

------------------------------------

Now choose some people to follow:

- Either in the global feed on your website

- or choose people by topic: https://fedi.directory

------------------------------------

Then people who you follow will share posts from other people, and you can choose if you want to follow them too.

Overpromises and overhyping of AI is making all of IT industry worse.

Everytime I start to discuss LLM/AI with non-IT people it is the same. Absurd expectations. Or denial of AI.

But as CEOs like Altman, Musk or Amodei have some much space in media, they can amplify their products - as good salesmen :)

I think that we are in times similar to 1997-1999, “everything will be web”.

Stack Overflow is an interesting case because these days most people ask questions on Discord instead. The data isn't public, and the search functionality is terrible. It makes no sense, but somehow companies still prefer it even though it's inefficient and the same questions keep getting asked over and over.

Looks like at least Discord is recently decided to finally fix the issues caused by having users & are trying very hard to not have any going forward through insane identity verification mandates enforced by the most toxic partner companies ever. :)

> the same questions keep getting asked over and over.

More user engagement, users spend more time on the platform. These companies don't have the best interest of users in mind.

> and the same questions keep getting asked over and over.

This is a feature not a bug. The people asking those questions are new blood and accepting and integrating them is how you sustain your community.

Google AI Overviews and ChatGPT are also killing traffic to information websites

StackOverflow was destroyed by a steady stream of miserable questions, and then by the infinite ego of moderators and power users.

They forgot that there are still people asking good questions and started to close everything.

Z downvote from z bozo weights the sama as one from an expert.

You need to bend backwards znd then lay flat to not annoy mods

Meta is the nest of psychopathic narcissists.

And many more.

Stack Exchange sites such as cooking or latex (and other niche ones) work very well. It is just that people are not full of themselves.

I started with SE ca 2014, loved it, participated a lot, accumulated half a million internet points and now hate the place. It did not age well.

Reply on news.ycombinator.com