You hit the nail on the head here. The real issue with abundant rare earths is that over 95% of the global shipment of rare earths has historically been controlled by China.
Because of this, there's significant exposure to their export policies and hence high price volatility for these materials. For instance, in 2011, Neodymium saw a significant surge in price just because the government decided to limit export quotas.