I don't think they're supposed to be "hands-on" with the engineering. They literally hire thousands (if not more) to deal with those problems.
https://github.com/facebookresearch -- there's like 1,000ish repo's here.
https://github.com/facebookresearch -- there's like 1,000ish repo's here.
There are quite a few engineers who aren't convinced. They seem to recognize the benefits and the limits of the technology. And they can see how it's failing in practice due to the technical limitations: energy demand and supply, heating and cooling, economic limitations, etc.
I think you're right though, Meta has real challenges ahead of them in terms of capacity and creating an actual product that can be monetized for the general public. It's worth mentioning that FB was doing AI long before the hype train started really rolling, and monetized it -- all behind the scenes.