Yeah, I think it's going to be a promising area of research. It's known as Chain-Of-Thought (CoT) in the literature and there are a few papers already out:

https://openreview.net/forum?id=_VjQlMeSB_J

https://openreview.net/forum?id=5NTt8GFjUHkr

https://openreview.net/forum?id=qFVVBzXxR2V

I'm also looking forward to explicit long-term memory mechanisms that don't rely on the main architecture's weights nor on CoT.