Refractive index of a material, typically ~1.5, is not a fixed single number for material. Rather it is wavelength dependent, because diffraction is of course quantum interference thing strengthening at new directions and canceling out elsewhere. Wavelength-index plot shows some sort of exponential or asymptotic, monotonically decreasing curve from UV towards IR.
This means any convex lens always has a higher than intended magnification at blue, higher still at green, okay at red, and only technically right at Sodium vapor yellow, creating "aberrated(NOT after Ernst Abbe)" color-shifted image at its focal point.
To counter this, convex and concave lenses built from different chemical compositions that show different rates of decreasing indices are used, such as Schott BK7 and F2, so that extra positive magnification for blue at first convex lens cancels out with extra negative power for blue at following concave lens, and so on. The chain of lenses can be continued to cancel out effects at as many additional wavelengths, as well as side effects and other types of imperfections, as desired.
Significance of Fluorite or CaF2 crystals in this context is, this material shows a completely flat curve on that wavelength-refractive index plot, referred to as "abnormal dispersion". It naturally focuses all colors across visible spectrum to a same point, skipping over a lot of lens and lens canceling out. Challenge is scaling out camera-sized crystals of Calcium and Fluoride with optical clarity is hard, which Canon has been trying for a few decades.