But isn't there a little bit of circular reasoning there? The median is the best statistic because it's the most common, and it's the most common statistic because it's the best.

I'm not advocating for any other single-number analysis presentation, nor do I think the median number is totally meaningless, but you're leaving a lot of data out in the name of creating a simple chart without asking if it's informative.