Ahh, if you're on KDE then Okular should do the trick, it should even update live when you update the markdown file.