This is great stuff - I'm impressed with how far you were able to take things in the browser. I also toyed with a tower concept - one of the things I settled on was what matters is data leading to data; to get to Y, i have to go through X first. So towers are a natural way to do that. I also think you have remained focused on staying true to the method of loci approach, which is admirable.
Additionally, I think having this sharable and on the web opens a lot of possibilities. I hope you keep working on it.
But man, that color change on your blog really messed with me. I have F.lux installed which adds warmth to whites to help with getting to sleep at night or as daylight changes and your site is like a rapid version of that. I'd prefer either not that at all, or at least scroll position based.