There are 6 mentions of the word Markov in the paper, not counting citations.