Yeah! It is interesting to try and figure out "what" the model is actually learning. It is a valid thread of scientific inquiry.