Looks great, just watched the video. Have you considered org-mode?
Why use org-mode as a format instead of Markdown? Internal cross-references. Org-mode feels just as light weight to me as Markdown for the most part, but it has fewer cases where you can't make things work. Worst case in org-mode, you mix in LaTeX.
Etc.
I think I still prefer to just write it in markdown. Word can't come close to the typesetting ability of LaTex.