IDK, I can see a future. It’s a one-man (for now) business, so minimal costs to consider. If he can swing consulting using the .cpp projects as advertising, that sounds like a good business.

Additionally, I can imagine companies investing and paying for the open source work to expand access to their licensed models. Use the same interface as people use LLAMA but upgrade to BetterModel, fully compatible.

Additionally, I could believe this is simply a build up to a future Acquihire, which is the most lucrative way to be hired.

He also raised a bunch of money, so I guess the plan is to figure out the business model as he goes.