What would HN recommend? I prefer Hugging Face as it has a stronger community built in but others prefer a open source project we can customize.
If it wants everyone to fork its models, having the model on Huggingface and using its libraries will increase adoption, as people are used to that format, having the quantization built-in, etc. Having to perform model conversions slows things down, despite TheBloke’s constant efforts to convert every format to every other.
If the model will only be accessible through CLI, APIs, or a website UI, then custom can make sense.
I am curious however, why name drop Elon and X.ai when asking this question?
With all due respect, I'm not sure how that is going to advance the technical conversation, and in some regards may indeed de-rail it and hinder the mentoring you might receive?
I hope I do not sound combative!
I am generally curious, as I see this behavior at $JOB, but in reverse. "My customer is seeing this." "I have a customer that is asking Y."
I am generally curious on the different perspectives that teammates can come from, that can drive them to take wildly non-congruent approaches, even with similar career experiences.
You work at a business and you think it's name dropping for a colleague to bring up specific customers' needs?
I'm trying to see the steel man version of your argument, but I'm not getting it. GP is working for a well publicized AI startup and shared that they are evaluating HF versus alternatives. I thought it was useful information, and it's germane to this thread.
Y'all could host models on HF, and use the HF format/download code (which is quite good).
But make a pretty frontend for it.
Down the road you could just host your own backend implementing the HF API, if such a thing is necessary.