Absolutely, it took me a long time to learn exactly that. Even though I remember what's in the file and where things go and can build the structure in my head, that's not without a cost, a significant one. Having a bad day, can't engage your "superpowers"? Whoops, now your entire project is in park until you get a chance to focus. And of course, as soon as the project hits someone else's desk, I can't rely on them knowing the whole codebase implicitly either.
One way I've used my ability in the past is that, for example, I can just read libraries or documentation and remember them, possibly better than the author does. I've done that for several major and minor versions of Rails, all historical now, but it gave me a significant edge at the time.
On the other hand, as I mentioned, that also means there's a disturbing amount of obsolete information muddying the waters - another commenter here mentioned that he has a hard time distinguishing between his recollections of his own voice vs other people's, in his memories, and that is much how it operates for me - Was that documentation valid for Postgres 7.6, 9.6 or 14.6?