SciRate: An open source website to browse, save, and comment ArXiv articles
scirate.com
scirate.com
For example, looking over my own papers for examples, a one page note [1] got more scites than a paper I contributed to that introduced several techniques cumulatively dropping the projected cost of simulating a chemistry thing by more than a factor of a million [2]. That's a cherry picked example, the pattern isn't that consistent, but having seen what happened to news sites it still worries me.
...not that the incentives for how to structure and publish papers are that great to begin with.
[1]: https://scirate.com/arxiv/2106.11513 [2]: https://scirate.com/arxiv/1805.03662
I welcome a platform that could allow more sophisticated mind-mapping. I've argued to no avail for years that MathSciNet should be open to machine learning, try to make itself a premier playground for machine learning, but it's an AMS cash cow and leadership prefers a 19th century model. Out to lunch recently with a former AMS president, he suggested I should do this for the ArXiv. That's not the point; one wants to encourage significant existing projects to land on our data.
Math is pretty much bifurcated between tightly-bound field tribes, only reading papers within their field, and roving players who recognize ideas in any form and chase them across fields. Of course, tribal mathematicians would dispute this. Better mind-mapping would reveal the connections between what's out there, rather than imposing a tribal mindset on its organization.
It would be good for mathematics to change this culture. It takes more courage than one might imagine to be a roving player. At hiring time, most departments let the tribes take turns. Just like growing up on the streets, pick a gang for survival, if you want to get hired.
SciRate seems to be trying to be that. It's not buzzing yet, but the UX has its heart in the right place. Unfortunately, I see from other comments that the site is pretty old and never quite managed to take off.
I wonder if my dream is ever going to happen... sigh
What would make _you_ contribute to make SciRate more buzzing?
And even back when I was a grad student, I wouldn't have been willing to bear all the weight of making all these discussions happen by myself. There have to be other people active on the platform to make it worth using.
There's a big chicken-and-egg problem, I suppose. But some subreddits, like r/MachineLearning, have gotten us off the ground at least.
Of the four, scirate.com seems the best option (unless you're focused on machine learning -- then arxiv-sanity is the winner).
I agree that comments on arxiv papers are "unlikely to take off" in either a commercial money-making sense or a "grow as large and popular as HackerNews" sense.
[0] https://graphthinking.blogspot.com/2021/12/comments-on-arxiv...
Amusingly it was even more useful to me after I left academia. Scirate’s community is almost entirely theoretical quantum computing, and so I was able to keep up with the field by looking every three months or so at the top papers.
As noted in other comments, the end point of vanity voting isn't great. It's not great at discovery, but I have found papers there I would never have read. But because it is a small community it actually does a good job in quantifying what the community feels is important. I suspect if scirate was ever more widely used it would be less useful.
Another interesting phenomenon is that no one ever precisely defined what voting meant. Some people think of it as endorsing. Others as bookmarking. Not sure what impact this has, but sometimes if you score your own paper people will growl at you.
In general, it could be appealing to have an open, established process for gathering public feedback on articles. It seems a scientific community would rather have their own version set up, where they could also curate content (rather than browse by category).
A grander vision of gathering feedback as part of a normal process seems desirable, but I don't know that the incentives for stakeholders are present to enable that.