If you're reading this, you may be interested in my other work on "Exploring Llama-3 MLP Neurons" as well.

https://neuralblog.github.io/llama3-neurons/