During the first year of my PhD I tried building metrics for interpretability of Graph Neural Networks… kind of obsessed about having “measurable” properties because I thought that was the “science way”.

I failed every single try, and after some time I began appreciating qualitative indicators.

Also, Chris Olah’s articles are lovely (Anthropic and also distill.pub ones)