The neat thing is that Anthropic might be able to do this as they massively moving their models to Google TPUs (Google just opened up third party usage of v7 Ironwood, and Anthropic planned on using a million TPUs), dramatically reducing their nvidia-tax spend.
Which is why I'm not bullish on nvidia. The days of it being able to get the outrageous margins it does are drawing to a close.