On the other hand, benchmarking against other special purpose hardware (like an FPGA, ASIC, RQL, etc.) is definitely of interest.
65 karma · joined December 4, 2014
On the other hand, benchmarking against other special purpose hardware (like an FPGA, ASIC, RQL, etc.) is definitely of interest.
Notice the emphasis on potentially, though. This paper only shows that 1) for a particular class of problems the quantum annealer has constant speedup over one current classical algorithms, and 2) the quantum annealer scales better for number partitioning than a few current classical algorithms.
They look at mostly combinatorial optimization problems, and largely they can not do anything faster than a classical (non-quantum) computer (i.e. a single laptop).
I read in future versions they may embed classical chips into their D-wave black box. Benchmarks at that point will be sort of silly.
I would think that if you expect people to take the "credit for reviewing" model seriously, then likewise they should take seriously the notion of "credit for being reviewed" or "credit for being upvoted".
Also, there would have to be a way to verify submitters/reviewers credentials (e.g. connection to a research institution). Obvious arXiv has a model for how this could be done.
I have to say that I am essentially 100% in line with their views on how the peer review system should be structured. However, the site, for lack of better words, sucks. It is slow, buggy, and poorly designed. What researchers actually WANT is the simplicity of arxiv.org with a login feature and peer-reviewed commenting.
Another group has another attempt here: https://publons.com. The website is much cleaner and better functioning, however, their idea is that peer-review may or may not be made public. It is mostly for people who want recognition for their peer review work.
I wish they would just team up, implement the ideas of the first group with the coding and design talent of the second.