What AI did to stackoverflow in a graph
data.stackexchange.com
data.stackexchange.com
I think a lot of people might balk at the word "inclusivity" today, but StackExchange had ridiculously high barriers to participation, making it inclusive to the long-time users on the site, but exclusive to the newbie participants who found themselves blocked for asking questions. They slowly killed the site in this manner.
The community might have survived this folly, even with AI, because it was still the best place for people with qualms about AI to ask questions... Except until StackOverflow management alienated those users, too, by shoving AI down their throats in every facet of the site.
Even I had internalized the vagaries and neuroses of the SO community but I had heavy reticence to ask questions, knowing I'd have to consider all the ways a bully eager to use their powers might misunderstand me. I can't imagine asking a question there without having had lurked for longer than a typical Bachelor's + Masters program.
Peak at 207K, minimum at 588. That might be an incomplete date point, so using the next most recent value 1226, StackOverflow has lost 99.41% of its activity.
Before I worked as a web developer, I was a formally educated and credentialed professional in a non-computer-related field with a pretty high barrier to professional practice, but a lot of passionate hobbyists. When I found the related low-ish volume SE, I excitedly poured hours into writing authoritative, well-informed, well-cited, thoughtfully worded, and concise but layperson-friendly answers. I also provided encouraging and positive, but usefully critical feedback to people that missed the mark. I knew how negative the format could be after using SO for years, so I bent over backwards to avoid discouraging newcomers with a punitive or imperious tone. People seemed to find my contributions useful because I became the top contributor in something like two weeks, and still regularly get points for things I wrote over a decade ago.
Some mod— a hobbyist with far less knowledge and experience, but a serious case of Dunning-Krueger— probably got annoyed that I was getting more votes than them because one day they started nitpicking the hell out of every goddamned word I wrote. I pretty quickly got fed up, and stopped participating about a month after I started.
::slow clap:: Well they might not have protected the utility or integrity of their knowledge base, but they sure protected the integrity of a bunch of people’s egos. That’s something, right?!
Mike Pall is the author of LuaJIT.
The reply had been either deleted or edited to the point of being wrong (memory is foggy), because Mike Pall wasn't an expert at SO, and had somehow not used the site exactly as intended. The mod was very dismissive and patronizing.
Edit: just checked it has been deleted so no longer visible to non moderators.
That isn't what happens. I know many, many people believe it to be what happens, but I know from years of seeing the process on the inside that it's absolutely not what happens in the overwhelming majority of cases.
The "quality of the site data" is a 100% honest motivation and I don't understand why people are unwilling to accept that. I and others have made countless attempts to explain it.
> I honestly don’t even think most of the control freak mods
The people you're referring to are not control freaks, and also are not "moderators". Most curation on the site requires consensus between multiple people who are generally not coordinating.
> Some mod— a hobbyist with far less knowledge and experience, but a serious case of Dunning-Krueger— probably got annoyed that I was getting more votes than them because one day they started nitpicking the hell out of every goddamned word I wrote. I pretty quickly got fed up, and stopped participating about a month after I started.
I can practically guarantee that the person you're referring to was not a moderator. If it was (someone with the diamond icon beside the username, and who appeared on https://stackoverflow.com/users?tab=moderators), you should have posted on the meta site about it. The pattern of behaviour you describe is clearly abusive and against the Code of Conduct (and would have been across all versions thereof), and would absolutely been acted upon.
If an "ordinary" (perhaps with higher rep) user was harassing you like this, that is why they put a "flag" link under every question and answer, and icon beside each comment, to raise a flag for moderator attention. This sort of thing is and always has been taken seriously.
On the positive side, all of the above have attracted many people to their communities who have contributed useful or interesting points. We all give away our thoughts and experience for free while participating in these discussions, but we gain in return from the freely shared knowledge and experiences of others. I also appreciate those who take the time to vote/moderate so that the best contributions stand out. Overall I find these online discussions extremely valuable and I’m sure others do as well.
On the negative side, there are some common failure modes. There have always been the trolls who will post offensive or misleading comments, and even when it’s a small minority, they can be disproportionately disruptive. There have always been the Dunning-Kruger contributors who would insist they were correct even as others tried to explain why they weren’t, and then the people who do know what they’re doing feel obliged to waste time repeatedly setting the record straight so no-one comes along later and gets misled by the incorrect or misleading contributions. I will never understand the current fascination with getting AI bots to contribute mediocre or just plain wrong comments in these discussions. But the worst recurring pathology by far, IMHO, is when there is some form of community moderation but that goes off the rails. It killed SO by deterring good contributors for petty reasons. It has killed many a promising subreddit; I have recently given up participating in several myself that used to be interesting, because their moderators started killing entire posts retrospectively, which repeatedly cut off discussions where some contributors had already taken the time to write up good solutions to someone’s problem or share their relevant experiences.
I’m not sure anyone has really got this right at scale yet. On smaller sites like HN, the moderation can be very good, but that relies on the fact that it can be managed by a small number of decent people. If your community is big enough that it needs to be more self-policing then the time-honoured question of quis custodiet ipsos custodes? is as relevant as ever. I strongly suspect that the only real answer to this is some kind of hierarchy where the operators of a forum set culture from the top, then just as a few negative contributors can spoil things for everyone and so some form of moderation is introduced, so a few negative moderators can spoil things for everyone and so some ability to guide or if necessary remove the use of moderation privileges is needed.
I'm no Jon Skeet, but I've had an account since 2009, I answered a question early on that's had well over 1000 upvotes, which I think is 10k of reputation for that answer alone.
Yet I certainly couldn't ask a question without suffering the same. That terrible experience wasn't reserved for newbies. I learned to stop contributing pretty quickly, well before AI.
Ask yourself: in what year did it become difficult to ask questions on Stack Overflow? 2014? 2016? 2018? 2020? Aggressive question-closing was part of their design from the very beginning. Their high barriers to question-asking was the cause of their rise, as their primary user was never question writers: it was Google, and anonymous Google users. The whole thing was an SEO play from start to finish.
It's fun to imagine that their aggressive moderation was the "real" cause of their decline. It feels so gratifying, doesn't it? Finally those assholes got their comeuppance, because of their bad behavior!
But that's not why they failed. They failed because SEO businesses can't survive when AI answers the question directly, without referring you any traffic.
(The same thing is happening to Wikipedia, BTW, which is also aggressively moderated.)
This graph shows a distinct change pre-dating AI, starting 2014, there's explosive growth which suddenly stops around then.
A soft decline which carries on until Covid caused a temporary reversal of that.
The soft decline then continues at a pace around where it was, until November 2022, when it suddenly accelerates to its death. That's ChatGPT of course.
But the site was already in decline, against the backdrop of vastly increased software developers and software development, because of hostility.
Software developers used Stackoverflow despite the hostility, because there was no alternative.
The early growth wasn't caused by the moderation, because the early moderation was a lot softer.
I've maintained that if they handled this AI-caused decline well, they could return the site to its better days before the flood of people who didn't know what they were doing, offloading the bad questions while getting still getting all the good ones. I'm not sure they're even trying.
[citation needed]
Well here it is, and you're wrong: https://en.wikipedia.org/wiki/Wikipedia:Statistics
The article creation and edits curves are stable. The former growing at a slightly declining pace, which is expected since the amount of knowledge is finite. The latter is literally flat.
The monthly page views are in decline on mobile (from ~5.7 billions at the peak in 2024 to 4.5 billions currently). They are stable YoY on desktop at ~3.7 billions, and have been rising in the recent months.
StackOverflow is dead, the WP community is thriving, even if the page views have declined a bit.
SO had a moat because of its mass, but the place was a cesspool.
People were desperate for an alternative, and ran with the first semi-viable one that emerged.
AI is arguably worse than SO for precision. It will hallucinate, and agree with you when you're wrong. But stack overflow is so unwelcoming to newcomers that people switched anyway.
Surely there's some value to asking a well worded question that many other people also have.
And yes, I've had my share of questions closed for some BS, including many in recent times closing 10 year old questions as dupes. Brilliant.
> The same thing is happening to Wikipedia
Can you explain? I am read-only there and it seems better than ever. Even in the era of LLMs, Wiki is still an awesome source.The year that Google made "open source contribution" a checkbox on your annual review. That's when almost ALL these types of sites went to dogshit. And then everybody followed Google which then weaponized it even more.
Once Google made Fake Internet Points(tm) worth actual money via your annual review, all holy hell broke loose over the sites.
The same thing is not yet happening to wikipedia as you can see with the pageview tool. You may be confusing a covid bump. At most any drop is within an order of magnitude.
It’s pretty much a meme now.
The other was the 'ability to read the room.' Even late-stage SO had the 'mods' not understand that they were the first google results, and their mean-spirited dismissals were being seen by thousands of hits.
I agree there's a balance, and maybe they edged over the line, but I was consistently happy to have the following be the outcomes
1. Answers were reasonably close to correct, usable, informative (teaching)
2. Your site score came to mean something -- I once had a hiring CTO say "Oh you have some popular answers on the techs we use"
3. Progressive unlocks helped guide the path of participation -- it was clear what to start with, and what to do next as you were taught their culture and ways. It's not very popular to say in 2026, but not every culture is good and it's important to curate culture and teach newcomers the culture of the space.
This was a bad idea, and worked terribly.
I have over 1800 answers on the site, many of them detailed, well-considered, long answers to difficult problems. But my highest rated answer by far was to someone asking two completely different questions at once (both of which have far better individual versions) in a way that was barely comprehensible even after multiple attempts by the community to rewrite in something approximating proper English.
For reference, the original version, verbatim:
> if I have list of numbers as [1,2,3,4,5...........etc ] and I want to calculate as that (2+1)/2 and for the second (2+3)/2 third (3+4)/2 ...... etc
> how can do as that ? like sum the first point with the second and divide it by 2 .. then sum the second with third point then divide it by 2 .... etc ?
> also how can i sum a list of number ? a = [1,2,3,4,5,......ect ]
> is it:
> b = sum(a) print b
> in i get one number !? it doesn't work with me help me plz
Moderation and community accessibility can exist. I think your points have described the early SO, but moderation has definitely gone downhill as the years went on.
I’m not new to communities with their own culture, expectations, and rules.
I do edit Wikipedia from time to time, and while you can always find drama everywhere, newbies are welcomed not thrown rule books.
If you make a well meaning edit that was formatted wrong as a newbie, you’d most likely get a welcome note and guidance; not threats or whatnot.
It’s like “Go away until you follow all our rules and we like you” versus “Welcome, thanks for contributing to Wikipedia, here’s our rules, feel free to ask me questions or help”.
And why do you think most people (and LLMs) just Google "<what they are looking for> reddit" ??
Something about the SO incentive system created the most hostile platform imaginable.
They have only themselves to blame for their own demise, and I'm happy to see AI is eating their lunch.
I liked StackOverflow for the first ten years or so of its existence, but I gradually stopped using it then suddenly quit altogether when valid questions were being closed unreasonably. At this point, LLMs with documentation in the context, issue trackers and eve the source code (if available) have surpassed SO. Now my main issue is telling the LLM to crap on my idea rather than wishing it were kinder.
LLMs took off for me when I realized I didn't have to be an expert to ask questions and get a non-patronizing response.
There was a time when I asked something along the lines of, "How do you get your own protocol like http://?" and was told to take my question to another StackExchange site. This happened several more times (along with dismissive responses and votes to close my question) before I gave up.
Then there’s the godot subreddit. Asked 2 questions? That’s a ban.
Imagine a child learning math or game dev coming up against that.
I’d quit. Curiosity extinguished.
The godot github has one of those characters now too. Really anti new user. I worry, I worry.
Anything that gives power on a basis of seniority, activity, volunteering, is guaranteed to suck very soon. There are just way too many mentally ill authoritarians permanently online for normal people to stave them off with naive good faith.
The biggest problem was highlighted from day one: StackOverflow was bound to become "DeadOverflow". It couldn't possibly work because the entire notion of having one correct answer to a question in a domain that constantly evolves was broken.
What killed the site was "Ever relevant question" showing up in a Google search (pick other search engine) and pointing to a "Correct and accepted answer" that was wrong with then another answer with more upvotes but which was... Already outdated.
That's why people coined the term "DeadOverflow": the very way the site was conceived would inevitably lead to dead answers.
And people pointed that out early on. Nobody listened, many of the OGs who created that company made a nice exit.
But SO was destined to eventually fail.
The entire karma/gamification/clique of users gate-keeping was bad but the issue of dead answers / DeadOverflow simply couldn't be solved, so it doesn't even matter.
Losing 99.41% of its activity is brutal but it's honestly surprising that a concept that couldn't possibly work even survived that long.
i got stung by exactly this.
i saw some of my early questions rewritten because some idiot mod that had not touched grass in a while thought that some words were better suited for stackoverflow.
and don't get me wrong: i'm not talking about profanity, n-word or racial slurs, derogatory terms or other controversial words. it was quite literally stylistic and tone changing.
dumb example: i like to end my posts with something like
thanks in advance,
--
znpy
which in my opinion is just common courtesy in a conversation between me and whoever will be kind to answer my questions. it's harmless and not controversial. and yet, some mods edited that out and left some irrelevant wording on that. my guess is they were farming points on the site.I'm so glad stackoverflow died and I don't miss it at all.
Actually, I thought they outright forbade AI answers? I don't know where else AI might have come in -- having an AI look for related answers instead of making users use the primitive search (for which almost everyone always used google instead) might have been a good idea. Probably wouldn't have been enough though once google started answering the questions before showing SO links.
I mostly participated in the site around the 2009-2012 and reached a bit under 100k of reputation and these were the dynamics of website:
* Most questions were low effort crap
* Users were mostly divided between only asking questions and only answering questions
* The reputation system favored: 1) easy questions (understood by a larger audience -> more people upvoting), 2) fast answers (before the question dropped from the front page; also answers with more votes got more visibility).
So, contrary to the usual narrative, the incentives and most activity was directed to answering newbie questions. That made up most of the volume, and it was what the reputation system rewarded. Even if a question got closed as a duplicated, by that time there usually were already answers to most easy questions. And deletion could only happen after some time (two days IIRC).The experts answering questions only stayed on the website because, sometimes, accidentally or not, someone asked interesting questions. Careful answers to difficult questions were definitely not rewarded through the reputation system.
The problem with StackOverflow, relative to, say, Reddit, is this format is not conducive to community-building. You need to have unscripted, off-topic, interactions with other people, and StackOverflow heavily penalized that kind of content. This only came later, with StackOverflow chat, and it was actually relatively successful.
True, you might want people who are more articulate or thoughtful than the majority, but if you go too hard on that, you end up putting a time limit on how long the community will probably last. People won't stick around a community that treats them like crap, and that's a problem because at least some of those amateurs/newbies will become your future experts and power users. The people scared away by bullies like the one mentioned here didn't come back to Stack Exchange once they became the type of expert the site needed. They just shared their knowledge elsewhere.
May the old answers keep compiling in the weights, since nobody's reading the originals anymore.
I used to look for questions to answer on my morning coffee. Then two things happened:
1. Rep chasers that rushed to answer anything with a copy/pasta from manuals (or at best semi related tutorials) showed up so there was no point or time in typing a complex answer.
2. Those long time users started downmodding "teach the man how to fish" answers and favoring "here's stuff ready to copy/paste" answers.
This was long before LLMs.
SO is not a place to ask where to get your homework assignment done, that's for sure. The gamification does not necessarily reward the best content, but I didn't experience hostility myself.
(I do find this site fairly hostile. And Wikipedia is the lowest possible hell, I've never in my life experienced anything comparable to the ferocity with which people prosecute their grudges, all the way to IRL doxxing. German language Wikipedia is another whole level of self-appointed officialdom.)
Damn. Doesn’t that just sum up so many interactions (and sadly, relationships) in life.
AI is a part if SO's downfall, but I've also seen a big shift of asking for help to places like discord.
SO has always had this thing that it's a wiki, not a Q&A site for people who are stuck - I feel like people have always wanted the second though.
Imagine if the system had let veteran users link a new question to an existing answer rather than a question, and if the asker finds it solves their problem they can accept it. At least that way new joiners would have a chance of getting their question answered.
Looking back it feels like SO was one of the first really gamified sites, and the people running it got weirdly focused on the point-economy aspect. They ran the site almost like "points" were a finite resource, and not to be handed out unless the user really deserved it.
I hope somebody saves it all.
Fancy wording but inaccurate. Plenty of long-time users (me included) left when the mods became insane.
This is significantly under selling it.
Stack overflow was like most of the forums in the late 90s in the early 2000s: hostile to anybody who wasn’t “l33t” hence the beginning of all the bullshit “l33tcode” mess.
I started writing software in 1996 as a 12 year-old and the sheer hostility that you would get from forums or even just reaching out to individual developers was absolutely unbelievable
I remember distinctly, I specifically reached out to Seth Robinson, as a 13-year-old kid who liked the dink smallwood game and was interested in building video game level editors.
His response to me was something like: “My rate for consulting is $800 a week.”
At no point in my 30+ years of being in software has software ever felt inclusive
I mean consider the hacker news is widely considered to be one of the most hostile communities on the Internet to new people, and had that reputation since day one
Only in terms of asking new questions, because this was never intended to be the primary use of the site. The entire point of the model is that one person asking a good question could save many others the effort of asking — and answering. But everyone who made an account had permission right off the bat to propose edits to questions and answers, for example.
> making it inclusive to the long-time users on the site, but exclusive to the newbie participants who found themselves blocked for asking questions.
Rounding it off like this is missing the point, and doesn't demonstrate understanding of or consideration towards the underlying rationale.
> They slowly killed the site in this manner.
It was never supposed to get even remotely as big as it did. It is entirely unreasonable to have ended up with 24 million open, publicly visible questions about programming, when that is over triple the number of Wikipedia articles about literally anything noteworthy.
> knowing I'd have to consider all the ways a bully eager to use their powers might misunderstand me
I can guarantee you that the overwhelming majority of such action is not motivated by "eagerness to use powers", not an attempt at "bullying", and not the result of "misunderstanding" the thrust of the question.
It is a result of misunderstanding what kind of questions the site wants, and why it wants that kind of question.
> I can't imagine asking a question there without having had lurked for longer than a typical Bachelor's + Masters program.
Reading through, for example, https://meta.stackoverflow.com/questions/433897 and understanding what is written there is literally all that is required.
I recently asked a LLM a question simply out of newfound habit. I realized while reading the line that this command seemed very familiar. I had bookmarked the exact same command in stack exchange many years ago. Of course the fact that stack exchange traffic has drastically declined came into my head. As well as the fact that this was predicated on them doing all that work so the LLM could essentially scrape, steal and now serve to me in this (for now) more convenient form.
These places are ultimately transactional. Taking personal offense to someone insulting your question is something you should learn to get over. The site overall would suffer. The vast majority of traffic wasn't people asking or answering questions it was using it as a search engine.
In Google I used to put in site:stackexchange or w/e because I knew answers there were less likely to be dead ends. Yes this is because some people got their feelings hurt. Iirc there may have been specific controversies re toxicity in meta, but scoping this purely to the question and answering side I never felt my own experience on stackexchange reflected something personal or done purely out of spite. I saw it as a way to ensure the site remained valuable as a place for high quality answers. Ensuring people have to write better questions is part of that. I often wish my LLM was meaner. My first stack exchange ribbing I just learned to ask questions better. I felt a human annoyed at my admitted laziness. This was valuable feedback. Should I have went boohoo and blamed them instead?
Now we have people wanting to fuck their AI girlfriends and waste your time with their LLM authored blog. If you think the problem with stack exchange was your feelings got hurt I just worry about what road you are leading us down. Having to earn your way in is part of human society. A LLM that tries to make you feel like a genius so you keep coming back is alien to most of how humans got here. I think the decline of stack exchange is less about a change in traffic patterns and more reflective of a continuing change in culture. I'm also guilty of course. But when I was reminded of my old bookmark, I went back and browsed other old stackexchange bookmarks. I did miss the very human nature of these questions and answers and comments. Yes including the occasional scolding and bickering. Sort of like this site. Filled with humans, yet not a complete cesspool. Oddly hopeful in our present age.
It was a good resource but absolutely toxic to newcomers.
Good Riddance to SO.
I still don't understand why anyone would go with that whole "no conversation please"
Where they went wrong, in my opinion, is in the implementation details.
It's mostly death by a thousand cuts: Requiring reputation to gain the ability to post comments, then having one's answers deleted as "this should've been a comment". Overeager marking of questions as duplicates, e.g. despite the equivalence between two situations being non-obvious (e.g. someone asks about data type A, and it turns out that it's a subtype of B for which an answer that applies to both exists; that should not be a duplicate, the fact that it's a subtype is the answer!). Endless other decisions like that, which wouldn't have taken any extra effort to implement correctly.
One feature they could've built that would have taken effort but also greatly helped against the common newbie complaint of "hostility" would've been a "newcomer track", which would've been more forum-like and guided them towards either formulating a good question or seeing that's it's already answered. In the latter case, some of the keywords that came up during this process should've been fed back into SEO so that future newbies would become more likely find the answer via a search engine despite using clumsy terms. I think they tried a simpler and worse version of this idea towards the end with "staging ground" but by then it was too late.
Yep, this exactly happened to me. I felt like a taker for always reading SO but not contributing. I saw an answer that was out of date, so I tried to point it out. I couldn't make a comment, so I put it in another answer.
Got banned from answering until I got my points up, and the only way to do that was to ask questions, of which I had none. Never mind that the information I tried to post could have saved someone from going down the wrong path. Totally irrelevant. Rules must be followed.
And then I discovered SO meta. Holy cow. Those people were so far up their own butts, they couldn't see daylight. I was morbidly transfixed.
It's there now. Too late I guess. https://stackoverflow.com/help/what-is-staging-ground
Instead of going in the same direction of everyone else adding AI all over the place and trying to eliminate the humans, they could have gone the opposite direction and played to their somewhat unique strength of having a bunch of actual humans and providing a place that actually fostered human and authentic interactions. Instead, for some completely unknown reason (money), they chose to commodify their own platform. Smart.
It quickly turned into simple questions and "send me the codes"
Good luck trying to write any helpful posts in the community anymore, someone will come along and respond with "AI."
You want to blow off some steam, and there is a laundry list of rules to read through.
Yeah, not bothering with all that.
"my side is right, the other is wrong" - has been too common of an occurrence, both in comments but also in posts and such frontpages as /r/all
They also had the problem that easy questions would get downvoted for being too easy, and hard questions would just not get answered because they weren't seen in time by the narrow group of people who could answer so they get buried by the algorithm. Working in something of a less common niche myself (embedded Linux), I never had questions get answered. I believe the question ranking systems and moderation policies really only worked for questions about new, popular web frameworks.
It was ChatGPT which did it in, but it could've been anything. It could've been a new group of people with some clout starting a fresh new knowledge site. People were ready to abandon SO.
No; answers got outdated because of people not doing what they were supposed to do, which is: post a new answer on the old question. (Assuming that the old answers actually are outdated. It happens all the time that decade-old answers are still perfectly relevant, or even still represent the Right Way to Do It(TM).)
Somehow, people never wanted to do that when it actually mattered, but would constantly post new, repetitive, low-quality answers on popular old questions (often re-combining multiple old answers) even though the solutions hadn't actually become outdated, simply because they were popular questions and they hoped to gain visibility from it (whether from reputation, or because user profile pages had a "number of users reached" metric which literally just sums the view counts of the pages where you have a question or answer, including views that occurred before your post).
That said, there are plenty of cases where an old question got closed as a duplicate of a newer question: either because it went unnoticed before, or because of deliberate action to reverse the direction of closure, with the goal of pointing future viewers to the best possible Q&A. This was explicitly in accordance with policy: see e.g. https://meta.stackoverflow.com/questions/404535 , https://meta.stackoverflow.com/questions/251938 , https://meta.stackoverflow.com/questions/423085 . As a general rule, policy is "timeless": the timestamp on a post is not relevant to determining the right thing to do with it.
Good for training data I guess - pure Question and Answer. Maybe they knew the platform would die so decided to optimise for that
Usually I’d find answers on SO. Relatively rarely I’d ask questions but, when I did, I’d always try and follow the netiquette rules of yore, and think in terms of, if I was a support engineer trying to help with this, what would I need to know?
Because I have supported products, and we’ve all seen enough bug reports and questions come in that we can tell when someone is going to be easy to help - even if they have a particularly tricky problem - versus someone who’s going to prove more challenging.
So I had this question about Elasticsearch, and it was at a time when the documentation wasn’t great, and you were actively encouraged to go on SO and tag your question to get help.
I wrote out in detail what I’d done, where I’d got stuck, what I’d read and tried to get unstuck, etc. It probably took me 30 minutes or more to pull everything together into a coherent post.
The very first comment was from some insufferable bellend saying, “Oh, so you want us to do your work for you, are you going to pay us too?” or words very much to that effect.
Literally, WTF? Why even post that? If you don’t want to help the option to simply go away without getting involved is always available.
IIRC I didn’t actually end up finding a solution via SO and instead layered some godawful hack on top of Elasticsearch to get what we needed - because I simply had other work to move on to and I’d already spent a lot of time on the problem.
But I think that was the last question I posted on SO, and maybe the last time I posted anything on the site.
As the years wore on I simply started finding it less and less useful, with often incorrect answers marked as accepted and - if you were lucky - the correct answers marked might be buried further down.
And then there’s what they wanted to charge for job ads versus how effective those ads actually were - again, this was better in their earlier years.
SO started out well - genuinely a breath of fresh air - but as time went on it felt like they thought their model was the last word in online help forums and they didn’t want to evolve to address its flaws, even if that had just been dealing with the toxicity, and the karma farming.
And so this is the result - a site that, like the dinosaur in A Sound of Thunder, is dead but perhaps hasn’t realised it yet - and, at this point, the way I feel is simply good riddance. It’s a shame, but - as you said - they did it to themselves.
https://www.penny-arcade.com/comic/2004/03/19/green-blackboa...
I don't buy it.
SO did develop a community in a way, but it was primarily the gatekeepers and rule enforcers adopting positions of pseudo-power. They liked using the sites’ rules as a way to control conversations and downvote questions.
Every internet community I’ve interacted with that builds up a lot of rules turns into this eventually. It becomes an attractant for users who really like memorizing all of the rules and deploying them on other people.
Even the curious growth spike in activity happened just before the acquisition. I wish I had time to do this analysis a bit deeper, but you can look for SO activity up until when chatGPT was released, it is really noticeable.
---
[1] Stack Overflow acquired by Prosus for $1.8 billion: https://techcrunch.com/2021/06/02/stack-overflow-acquired-by...
[2] Prosus to acquire Stack Overflow for US$1.8 billion https://www.prosus.com/news-insights/2021/prosus-to-acquire-...
But where did all the users go is something that would be interesting
I remember being amazed that some internet stranger took the time to understand my question and provide some great solution where I was stuck. It gave me a little encouragement and social connection as I plugged away on a project alone.
I miss that feel good human connection when an LLM can quickly get me an answer.
I never had an account, never asked or answered a question on SO, but found the answer I needed there plenty of times and got on with my work.
Being stupid in this case is irrational self-(mis)-perception.
Probably they really meant to say you are lazy and shift work on mods.
Then you have to re-ask it, now with a couple extra disclaimers spelling out that indeed you did use the search function but no, the other visually similar question isn't actually the same as yours.
Then you'd get maybe 2 comments and -2 in downvotes.
The whole damn business model of a forum was to provide a solution to people that didn't want to / didn't know how to RTFM, but everyone was toxic as hell toward one for not wanting to do that.
I think Stackoverflow was the last incarnation of romanticized old-school Q&A forums where you first had to earn your badges before being treated with respect. Luckily today's new projects have much better documentation, issue tracker's etc. And apparently AI is able to work with that by now...
That's obviously because initially there were a lot of basic newbie questions to be asked, and those continued to be relevant in search results, so the amount of new questions went down over time, as there were fewer relevant unanswered questions left.
Not sure I would blame it all on AI though, the incentives of SO only worked while there were worthwhile questions to answer and make you feel smart about. After that well dried up, the only thing left was the stuff AI can do with a prompt; ironically AI got a leg up by scraping SO.
This is similar to the evolution of Wikipedia, except the format of WP allowed it to transform into a feudal dictatorship of nerds who feel like they are deciding what's true, and they can get off on that.
SO did not have that kind of incentive to keep the nerds around.
Literally describing how academia has worked since time immemorial.
I think other helpful places like reddit, discord, web forums etc might be what hit SO 2014-15 onwards.
AI seems to have given it a blow of mercy to end the misery.
At the same time, this is graph is something that really should not look anything like a bell curve. So the format is probably just a coincidence.
Except if the "all the questions have been asked" hypothesis is correct. What I really doubt.
That's also something what AI did to the internet :(
There was an era of the Internet where moderators were seen as the solution to all the problems of Internet communities. Then we discovered that those people that enjoy playing petty bureaucrat for virtual karma will end up alienating normal users, especially in places that wants to maintain a certain standard of quality and not aim to the lowest denominator like Reddit, for example.
"Politics" being another word for "game theory when it's about humans"
And the solution turned out to be putting every user in their own safety bubble of recommended conten and expanding the bubble only when user gets adventurous. And TikTok became gold standard for that that everone tries to emulate with varying degrees of success
a) They don't acknowledge this was a problem.
b) They are unwilling to tackle this problem.
c) They are unable to tackle this problem.
I'd love to know what the people who run the site (from a business perspective) think about this. It might offer some insight into its cousins that are going down the same path (reddit / wikipedia).
Most people who came to SO wanted the site to be something it fundamentally wasn't supposed to be; that it in fact specifically existed not to be, to provide an alternative, because the thing that everyone wants (a discussion forum) is actually bad.
When the site was launched, lots of people seemed to agree with Atwood and Spolsky that discussion forums are bad and that they knew better. But in the long run, this still proved to be a minority opinion, by a long shot.
In short, I don't acknowledge that it was a problem because it wasn't. It was expected and okay that lots of people didn't want to engage with the format. The format was not for them. The purpose of the format was to produce an artifact that would benefit them indirectly, for free, by improving Google search results (until Google fucked it up).
But the site (the platform itself, and the people implementing it; not the community) fucked up by failing to recognize that most people really do want a fundamentally unproductive, unfocused social environment (and a help desk!) after all.
More importantly, it fucked up by presenting a UI that misleads people into thinking they could have that experience (post a question and there's space for answers under it; obviously that means that people are answering directly for your benefit and not anyone else! and of course we can go back and forth about this, and they'll help me solve my problem! and there are votes, like Reddit!)
There was a few noteworthy company post, especially those after the mass layoffs / private equity takeover on the meta site that acknowledged the problem, so its certainly not a), even when you apply a strict standard about the terms in which to acknowledge the problem (which was well-known long before). Those company statements had some rather clear and well-received community commentary below that essentially questioned whether any of the suggestions on tackling the problem should even be tried. The very-much-not-welcoming onboarding experience, while it had great potential for improvements, was yet serving the sites unique needs quite well. Two weeks of persistence and reading the manual were not much of a detrimental filter.. not to those that would eventually go on to contribute back for many years. And those were the ones that ultimately mattered. Not those one-off solve-my-homework posts that only saw indifferent/annoyed moderation action. That probably still wonder why nobody took their hand and spent their evening guiding them through the steps necessary to make their post useful to anyone other than just the original author.
a) they choose a certain very specific ideal as a target, but utterly failed to convey that to a majority of site visitors;
b) their picked target and path visually and functionally matched by like 90% with a thing already existing for decades previously and very familiar to a majority of internet users - with a regular forum with sections and treads;
c) they make fundamental errors even inside the scope of their own ideal and vision - like for example apparently not taking into account that software with identical name can have different versions;
d) while they copied forum structure (failure B) they also failed to envision (or did a mistake in that) how the ideal target result would look like a long time in the future;
e) they failed to acknowledge all of the above, reflect on and fix own mistakes, instead they declared those mistakes "a culture" and persisted in deepening them;
Basically they picked a forum format, known at those times to literally everybody on the internet and decided to use it to make something vastly different, while failing both at communicating that intention and also failing at actually adapting UI and tools to better suit their target.
What happened is that as the corpus of useful info increased, the need to pose new Qs decreased. AI much accelerated that decline by making available an 'oracle' trained on that corpus.
If someone wants to get help, and they end up on Stack Overflow, the structure looks like a Q/A site, and they treat it that way. The people "in the know" then accuse them of being "bad" for posting a question to a documentation site. Combine that with the gamification, and it had to turn into the toxic mess that it did.
When I first heard of the gamification method of moderation, I thought it was a really good idea. But, over the years, it has proven to be a means to enforce an echo chamber, rather than a way to filter out bad posts. I have yet to find a site (HN included), where that isn't true.
* Moderation went bad. I stopped moderating/flagging after it was deemed unhelpful?! I know it's hard to moderate a platform like that, but giving me a slap in the face when I volunteer my valuable time is not the way to do it.
* Questions closed because they weren't "programming questions", but obviously about tools devs use every day. Again and again, they were the TOP google results. You'd click on it and found a old question closed because it was considered off topic. As a business, you seriously need to ask yourself some hard questions when you fend off users like that.
A lot of what we have today was built with help from that community
And then it started being stupid questions. People who clearly had barely tried anything and just rushed to SO with a half baked question. Answers were just pointing to another thread that already provided the answer. It definitely started before LLMs. I think it lined up with the aggressive "learn-to-code" push.
Now do a graph for the money.
https://www.wired.com/story/google-deal-stackoverflow-ai-gia...
Sure there is, number of questions halved from 100K in first of November 2022 to 50K exactly one year later.
On the rare occasion that I DO want to go there, they greet me with an impossible gate that takes 15+ seconds to pass on Brave and gets invalidated quickly.
If anyone from SE is reading this: you already failed to protect your data from the LLM crawlers, SE is no longer that much interesting to them. The only visitors you're gating today are not bots, they're humans.
Never meant to be protected. I only contributed there because it specified in no uncertain terms that everything was going to be CC BY-SA licensed and posted in a public archive every now and then, so you do not need to scrape to use & redistribute if you intend to adhere to those terms. That would have been sufficient protection, if only governments had not u-turned from Walt-Disney-Copyright straight to "Open"AI-Copyright.
Instead I directly go on the project github page and ask the question directly to the mainteners.
Today I'd expect even when someone is googling and a question is relevant that most people will just read the AI overview.
SO tried to optimize the Q/A by eagerly rejecting repeat questions, without considering what the consequences of that were. If you’re in a classroom / lecture hall, your teacher / professor isn’t going to chide you for asking an “obvious” or “repeat” question (bad ones might). Imagine if every time you wanted to talk to a TA or professor you first needed to lookup previously asked questions in a database and then, iff your question hasn’t been asked before, you may ask the professor or TA after hours. Programmers might call this system “efficient” but most people would be pretty unhappy with it.
I read a great article not long ago outlining the full series of events and changes that led to its downfall. I wish I could find that article, but I've forgotten where it was.
This is revisionist history. People told SO that they were leaving for YEARS because of how incredibly toxic it had become. It was already giving outdated answers before ChatGPT shipped, because new questions/potentially updated answers were [Closed] [Dupe] immediately.
Their answer was essentially "We aren't a Q&A site, we're trying to be a knowledge base! So closing all questions on a Q&A-stylized site, and extremely abrasive moderation, is working as intended."
They entirely did this to themselves. The community was toxic, their policies were toxic, and they didn't listen when warned as such repeatedly - just doubled down.
The Monica affair was one of the first symptoms.
In 2023, Stack Overflow had already started making unpopular pro-AI moderation decisions, and in 2024, they started mass banning everyone who deleted their questions and answers in protest. I don't think it's wholly incorrect to say "AI killed Stack Overflow" when the death blow came from crazy pro-AI decisions from the admin.
Interesting to compare with MathOverflow which has distinctly different policies (only research-level questions) and professional community: https://data.stackexchange.com/mathoverflow/query/1953768/st... - also falling lately, but by a factor of 2-3x from peak rather than 1000x.
It was basically an imposer syndrome enforcing machine.
Funnily enough, there's now a "StackOverflow for Agents": https://agents.stackoverflow.com/recent
Total monthly number of StackOverflow questions over time
https://news.ycombinator.com/item?id=46482345
And previously in 2025:
Stack overflow is almost dead
Step 2: The platform becomes the ultimate knowledge base with community-curated answers on virtually any question related to software development.
Step 3: Another company scraps the community-driven database to train its model.
Step 4: The model is so efficient that people start asking questions of the model, killing in the process any traffic to the platform that helped to create it in the first place.
Step 5: Profit. People who spent years asking, answering, and curating programming knowledge for free are now paying for that knowledge repacked in the model weights. The original knowledge base is essentially dead.
Question: What programming knowledge base will be used to train future models?
Are we at the Skynet moment where people will be totally cut out of the loop from now on?
I always found the format of the side obtuse and the culture not very welcoming. My most popular answer ever was something about JavaScript from 2008 or 2009, and to this day, people come in and say “this isn’t the way to do it, this is outdated“. No kidding, but every new question about that gets closed as a duplicate.
Their goal (loosely described) was so that if you pulled up the front page of the site, you'd find questions that are interesting to read and answer.
If you, as a professional visiting the site went to it and found the front page with things that were trivially answered by reading the documentation or "how do I draw a triangle with stars?" ( https://stackoverflow.com/q/10932962/ type things) you, as a professional, are less likely to stick around.
In the period, Stack Overflow was reducing the ability for people to curate content and trying to boost "welcoming". https://stackoverflow.blog/2018/04/26/stack-overflow-isnt-ve...
Part of this is that much of the early writing style was intended to mirror technical writing. In reading https://learn.microsoft.com/en-us/powershell/scripting/devel... one doesn't find "Hope that helps" at the end of the page.
It takes a while for a person to understand the norms of writing for a given audience. In the early days, people either came to it with that mindset or were able to be given more attention and guidance as to what the expectations for the site were. When Stack Overflow become extremely popular with college students and people outsourcing their work ( https://news.ycombinator.com/item?id=48960245 ) the ability for the... for lack of a better term "elders" of the site to try to get people to understand how the site worked and its expectations.
Many of the new users expected Stack Overflow to work much like forums - with a back and forth between people and a chat like environment... that wasn't so. The use of the curation tools to try to help onboard a person were deemed as unfriendly and "toxic" started getting tossed around.
Stack Overflow corporate, trying to be sensitive to the broader cultural movements at the time and the "we need to make this a more inclusive space" made it harder to curate and began a campaign of removing or limiting curation tools as part of "welcoming".
During this time, there was one tool that was enhanced in its effectiveness. If you had a gold badge on a tag you could close it as a dup of another question categorically. Rather than "this question is poorly written and it is unclear what you are asking" (requiring 5 close votes from different people - that would never happen if it didn't happen in the first few minutes because few went to the review queues) they could close the question as a duplicate of what it might be.
That didn't help things when it came to the perception of the site. It was a last ditch effort to try to make it so that the front page was the well asked questions.
Combining the reduction of curation tools, labeling their use as gatekeeping, the growing ratio of new users to elders, and corporate quite literally saying that those people who were doing the curation were the bad guys... well, a lot of them left or reduced their activity.
That in turn made it so that it was harder to find the well asked questions and fewer people were around to answer questions. Note I write "well asked" not "valid" - a lot of people claim to have a valid question but don't ask it in a way that is well suited to the Q&A format.
Combine that again with reductions in staff, various awful "experiments" in the name of improving engagement. That was akin to firing half of a construction team at a house while having them add a new patio... all the while the basement is flooded.
And so you've got what is there today. Very few curators left compared to 2016. Few caring answer new difficult questions. The easy college homework questions (how do you draw a triangle) and the outsourcing of work to free labor is now done with an LLM... and there's no coming back from that. ... And few people believe in the mission goal of Stack Overflow - and those who do, don't believe Stack Overflow corporate believes in that mission goal.
It was such a hostile environment. It always seemed like you basically had to already know the answer to ask a question.
The Fall of Stack Overflow https://observablehq.com/@ayhanfuat/the-fall-of-stack-overfl...
What’s left to ask now is ”plx fix my homework” - [pastes error log unique to the posters environment]. Something that Claude is very good and very tolerant at.
Stackoverflow aimed to be a knowledge base. And knowledge base has a ceiling limit. They simply reached the point that almost all questions (regarding the knowledge) were asked for them. You can argue that newer or niche libraries or languages knowledge is still lacking there, but I have never seen them getting closed, just not answered.
Questions getting closed for no reason, answers getting deleted randomly.
Don't waste your time asking & answering questions on SO.
Contributors responded by going to delete their own respective contributions en masse. Upon doing so, were banned by the platform mid-process which then led to people going back to revise their contributions to be false rather than deleted.
I guess that’s “LLM related”
As someone with substantial "points" accumulated all a full decade ago, I can easily see why. If you only allow certain opinions and criteria for specific subjects, your user will eventually shrink to only the few that possessed them.
It's a Spartan death. Don't blame it on the Persians or Athens.
However looking at the shape of this last drop, I think it wouldn't matter if the SO was in its prime when it happened. SO would die regardless, at the schedule dictated more by strengthening AI rather than its own.
It's obvious that LLMs affected their traffic by a huge amount, but making the page flow worse for me was their doing
You cannot reply to a post to either provide correction or solution because you don't have enough "points" to do so.
You were forced to complete an insane list of requirements just to comment. Let that sink in.
I can relate. I was active there from 2009 until about 2014, which looks rather like a plateau in the graph. It still showed up in Google searches but I mostly just lost interest in participating.
Guess where these people went? Reddit?
Mods were so shitty I always wanted to have my schadenfreude on them.
That's primarily due to AI answering my technical questions.
Then they forbid using AI to answer questions - another huge miss. They could have leveraged AI as a great cool gig on their web-site - they didn't. Too bad.
i dont feel guilty for creating a few hundredsaccounts on there to essentially get coding work done for free in the early days. I would have a script where I ask a question in the laziest way possible, post my code, and wait till some sucker fixed it for me. On a good day I could get roughly 16~21 questions answered. If they blocked me I would just use another account. I would also upvote my own questions if i wanted to get them answered quickly. eventually all of the accounts got banned but I've been able to ship a SaaS in php with barely knowing the language.
I was on SO for 14 years, with an accumulated rep of a few hundred thousands. At the beginning the crisp philosophy of the site was great: a question, and answers. Sometimes comments. I believe it set the tone to questions today, without the hello everyone at the beginning and kind regards at the end. The aesthetics of the site were good too.
And then, somewhere around 2018 I think, things started to go south. Meta became a lair of psychopaths with an ego they could not loft. Asking a question over there meant immediate downvotes.
Then came the elitist groups, such as in the Golang section. I asked nice questions that were immediately downvoted at nauseam. This was not the case in other groups where you could find actual help.
Some other SE sites went that way too (cybersecurity, some linuxes) and I gave up completely.
There are however wonderful, more or less niche sites that are still there (LaTeX, cooking, ... ← please do not break them), they thrive because they are small-ish and the egos do not fly too high.
Otherwise I moved to asking questions on Reddit, which is a ht or miss.
I asked to see one of the questions from 2024 - it could have been solved with one LLM search.
We have eliminated a whole genre of peer to peer communication.
Smaller fraction of novel questions are still submitted on SO, github discussion and mailing lists.
Yeah, bro, I'm not a statistics professor so I can't provide you with the "details or clarity" you need. I tried my best and if that's not enough, fuck it. Same story on history.SE: https://history.stackexchange.com/questions/60710/how-did-hi... If you're gonna require "evidence of prior research" I won't bother. The bots are way friendlier and just as knowledgeable.
The golden goose were users asking questions, not the anal-retentive content curators. SO let the latter drive away the former.
By the way, at least as far as what it is showing me,SO is an AI site now. Home page Ask a question goes straight to an LLM doing RAG against Stack Overflow.
Edit: actually they tricked me into asking AI. The text box to ask AI is right next to what is actually an Ask A Question button that skips the AI.
It's training data seems limited or out of date because it had no idea what Gemma 4 E2B was. It just said that wasn't in the SO data and could I explain wtf I was talking about please. I guess not Gemma 3 either. And no web search. So it's useless for me today.
Interestingly, the Stack Overflow AI answer is provided by OpenAI, and these may be the most useless responses I have seen any time recently.
Whaddyaknow. Got me a little twinge of the good ole' rage tingles after all!
It still has some value today, as sometimes you can find useful information on SO, but its peak days are long over and I don't see how it can manage to come back, with or without AI slop. It would basically require a lot of re-design and some things that never worked, such as the karma system, should be changed. Also moderators - they kill sites. That happened to reddit - I gave up after censor-mods constantly restricted everyone.
The normal day to day devs just don’t have the need to go to stackoverflow anymore.
One would have to explain both consequences or dismiss it as coincidental.
FWIW I rarely have the need to ask questions at the programming level to anyone anymore. It’s just not the type of thing I bring up or anyone else. We now talk about architecture and company direction.
Many people talk about the negativity, and they are right, but I think the reason more than anything is the waiting. On SO a good question might get answered in minutes (if it was easy and someone was karma farming) but it could be days or weeks for general purpose stuff; compare that to a few seconds for an LLM its a no brainer.
That's hardly a death sentence. More likely just the gradual adoption of higher level frameworks and languages with less ugly parts.
Honestly because of this and the relative lack of actual pros on the site, real pros will get pushed out and the site will actually build a collection of misinformation. That's probably why pros feel that software quality has dropped so much in since stackoverflow.
If I want LLMs to belittle and passive-aggressively mock me while providing borderline help, I can prompt them to do that. But I could never turn that off on stackoverflow.