"Gemma Scope is a research tool for analyzing and understanding the inner workings of the Gemma 2 generative AI models. The tool allows you to examine the behavior of individual AI model layers of Gemma 2 models, while the model is processing requests. Researchers can apply this technique to examine and help address critical concerns such as hallucinations, biases, and manipulation, ultimately leading to safer and more trustworthy AI systems." [1]
Would it be a stretch to say that this type of output is the "abstraction" mode of a model? In other words, linking the semantics of a text or word to more abstract concepts (e.g.: cat -> animal, beans -> food).
For example, the capacity for abstraction is fundamental for scientific and creative development.
[1] https://ai.google.dev/gemma/docs/gemma_scope