I agree. It is not common at all in most of Japan.
My own anecdotal experience, but for reference, I believe horse meat is orders of magnitude easier to find and consume in EU countries than whale in Japan. And yet I'd argue most Europeans wouldn't consider horse meat common at all.