Because books speak of books, as with the manuscript, which is a letter about a book about a book about another book, until at the lowest level the story speaks of even more lost works, whose ideas survive through the hand of a scribe who does not understand them. And the burning of the library becomes a burning bush, releasing not destroying knowledge, for it is the light that matters.
It is my favourite of his as well. And thank you for sharing the joke about Wittgenstein. :)