Pandoc only handles a subset of org-mode markup.
IIRC last time I tried this (long ago) there were a number of gaps in things like org-mode tables.
At the limiting case, the (common or uncommon) elisp extensions (e.g. org-babel) will likely never be processed by third-party tools.