Memory might be a moat. A cynical view is this is why openAI is buying up all the capacity for HBM. If they have all the memory then we plebs won't be able to afford hardware to run local models. So we instead we have to rent their models basically just to get access to the memory.