"Green" AI is a misnomer. Inference by its nature is not efficient.

Speed, Accuracy, Efficiency - Pick two.