I ****Ing Hate Science
buttondown.email
buttondown.email
Software engineering research is a train wreck - https://news.ycombinator.com/item?id=27892615 - July 2021 (90 comments)
Shouldn't all same-URL submissions be considered as one, at least in a certain time period?
Aside from the substantive points about the cost of bugs, the subtext of the article is that real science is frequently difficult, painful, frustrating and ambiguous, in contrast to the neat stories that make up the "science as a bundle of facts" world-view.
A better title (slightly amended from an existing sub-head) would be something like "Are Late-Stage Bugs Really More Expensive?"
The problem stated is that instead of being able to find widely cited or good papers, any amount of research involves trudging through hundreds of bad, off topic, outdated, unrelated, or otherwise useless papers, just to get an idea of what is being talked about in the field. And even when getting there, what you find may be completely non-practically relevant in the end.
You say you hate science, but then you go on to state the opposite, that you actually hate stuff being unscientific, not verifying, not checking the facts etc.
Great.
The coverage is significantly juiced up, and readers will take the articles as fact, as they have no reason to believe otherwise.
The author's example of a highly-cited IBM chart that can't be properly sourced plays on the same principle as the IFLS sites.
Even in experiments where it's very easy to make a study replicable by simply sharing the code, many people do not. I take this as evidence that the goal of research is rarely good science.
Sighs. This hit very close to home.
- Design bugs are (more) expensive to fix after implementation.
(I really don't want to be an asshole here. The piece is well written. Particularly the part where it criticizes how a lot of CS research is done nowadays. But so many words for such a remarkably obvious platitude!)
I read this article before I found that out, and afterward, it just seemed hypocritical to me.