Has anyone considered building something like this for Matrix?

There are lots of open-source communities there, I imagine it would be helpful for debugging (and discovery of Matrix itself).