There are two numerically painful parts of the problem: the advection term and the oscillation inducing terminal condition (because it has a discontiuous derivative). I like to deal with advection by transforming the equation to an advection free equation. I'm under NDA on the best solution to the oscillatory terminal condition so I can't give that one away unfortunately.
AFAIK, discontinuous first derivative per se may act as a seed to an oscillation due to its high frequency content that are not captured by any finite resolution algorithm (n.b. Gibbs phenomenon). But it is Crank-Nicolson that characteristically creates these oscillatory problems -- in other words, there are algorithms that can gracefully handle the discontinuity without creating oscillation.
Given the exercise boundary, the American Option Price can be written exactly as a one-dimensional integral. That is the key insight to this superior method.
( I'm a fixed income quant, so I didn't look for it until now.) For a more advance model than Black-Scholes, e.g. local vol I don't expect it can be extended, and one would then need use some PDE based method.
(I wish I could talk more, but yeah, legal obligations)
After a bit more googling, I found these more recent slides by Jesper Andersen, where he believes that the Leif et al method could be extended for local vol (see page 25): https://www.cqfinstitute.org/sites/default/files/4%20-%20Jes...
For example, option price among other params depends on the interest rate. For the last decade interest rate was around 0% in Europe and slightly higher in US. If you train on that data only, there is no chance to "learn" option prices in the high-interest-rate environment which we saw for the last few years. Hence, you need synthetic data to learn that region of the market space.
The finite-difference covers wider range of problems, including stochastic volatility models, like SABR or Heston.