Compare with the Serbian/Croatian "languages" that are far more mutually intelligible than varieties of the Chinese "language".
I've heard that Arabic also has far more variance than is between Serbian and Croatian. Even though we often refer to it as a single language, it's actually a very diverse selection of varieties that are not all mutually intelligible.
In short, the distinction is pretty arbitrary.