I would use something like pandas or dplyr (Python and R libraries respectively). But that's for answering specific questions like finding duplicates, missing values, overlapping columns etc. - in my experience there's usually some more specific question to answer than just diffing in a general sense.
That's great. I use these myself on a daily basis, but it can turn into quite a grind, especially working with novel(to me) datasets.