Testing Distributed Systems for Linearizability
anishathalye.com
anishathalye.com
If anyone is interested in the benchmarking aspect, there's a discussion over on lobste.rs with aphyr, the creator of Knossos: https://lobste.rs/s/pdy68r/testing_distributed_systems_for
Linearizability testing does help catch bugs, but in this implementation, it doesn't offer much guidance on how to go about finding bugs. That's something I'm currently thinking about, as this style of testing is something that I'm thinking of incorporating into MIT's 6.824 Distributed Systems class. We care about testing student's implementations for correctness, but giving good feedback that helps students find bugs is even more important than just telling students whether or not their implementations are buggy.