I think I'm misunderstanding you; Gibson doesn't live in California.
I took the quote as Gibson believing that nobody at all can imagine the past as it was, objectively, but only their own personal past, colored as it is by all of the moments that they have lived since that (past) moment.