I have the Air too. It's thermal throttled. Try someone's M1 Pro, or the Mac Mini. Also make sure you're using the GPU (I'm not sure but AFAIK these models can run on CPU too?).

People at my employer use maxxed out Macbook Pro M2 for their ML research needs and say you can't get better performance for that price (in a laptop).