I feel like this is more and more in the majority too. So much so that AMD is talking about their chips for inference as much as training [0].

0. https://www.theverge.com/23894647/amd-ceo-lisa-su-ai-chips-n...