This is a great question! You're addressing the idea (roughly along the lines of Occam's razor) that if there's any way to explain the "extra mass" without invoking a new form of matter, it should be preferred.
Most of these other possibilities have been largely ruled out via careful observations, which are detailed here: https://en.wikipedia.org/wiki/Dark_matter#Composition
One of these possibilities, for example, is that the missing matter is actually contained in a great many small, dark, massive objects scattered throughout galaxies -- such as failed stars, planets, or even black holes -- rather than in a diffuse, invisible material. This possibility has actually been largely ruled out through a number of statistical "microlensing" surveys that are sensitive specifically to the presence of massive, dark bodies (via their gravitational lensing of background stars -- a rare event, but measurable statistically).
https://en.wikipedia.org/wiki/Massive_compact_halo_object#De...
I think the wikipedia Dark Matter article is actually super well written and should address these issues, too!