> legitimate researchers go to extensive lengths to demonstrate that the procedure they did did what they said they thought it was going to do and then it didn't have side effects. none of the self biohackers have done that.
I trust you (haven't checked biohackers much myself), but as with any field of knowledge/research, the opposition you suggest has nothing to do with credentials and everything to do with intellectual honesty, integrity of the researcher.
I mean, let's take programming since it's HN. Say you compare two programs. You could follow the scientific method (hypothesis -> experiment(s) -> conclusion -> new hypothesis -> etc) like any decent engineer or scientist would... or you could just randomly "feel" which is better "in your opinion" — basically being a charlatan with your own topic.
Unless you're doing marketing, you should be selfishly attracted to the truth — which is really better / faster / etc — because you need the tool for yourself, not to sell it to someone else. I'll never understand charlatanism in research, I won't; but even toy benchmarks for lulz or journaling can be made scientific, easily. It's just a logical framework, which I'd think any self-proclaimed 'reasearcher' knows in and out...
This is isn't to say that you can control all variables in real-world experiments — biological and social research are the hardest in that regard. Sometimes you gotta take a leap because you won't ever be able to "prove" anything beforehand, it's only retrospectively in statistics that you'll know (at the level of metastudies). We've taken many such a bets with public health, family health, our own; whenever the `estimated risks / perceived benefit` ratio makes sense.
I do agree it's wrong to categorize beyond these facts, e.g. credentials of the author of a good idea, or lack of "proof" thereof, have little to no meaning historically — can't stop an idea/solution whose time has come. I mean, Js is the most popular language with Python, let that sink in for a minute. (lol)