That sounds neat. Have you got a reference to it handy?
I.e., set up maximal likelihood, take logs, and you immediately get least squares for g(x) a gaussian. If g(x)=exp(-|x|), you get l1 minimization. Other distributions give you other things.
The general topic to investigate is robust regression: https://en.wikipedia.org/wiki/Robust_regression