Cohere: The world’s most powerful NLP toolkit
cohere.ai
cohere.ai
As it is running on cloud machines as a SaaS business that might theoretically just mean potentially most available computer cores for a comparable offering.
Or any other BS market g can come up with. At the time of writing there isn't even a footnote or anything to that claim. Companies that do this are on my instant black list. Why should I trust them, when they don't show sources, or anything to back up their claim in an easy to discover way.
Edit before potential answers: Maybe they have something to the claim. Maybe the offering is actually great. I wouldn't know. I wasn't able to somewhat verify the big claim and therefore did not go deeper into the offering. Unsubstantiated marketing speak just rubs me the wrong way.
Might be a cultural thing.
I wasn't even interested in spending more time than looking at around 5 pages to see if the claim might be substantiated somewhere. It wasn't obvious so the heuristic is that it is not substantiated.
I'm totally with you, and...
> Might be a cultural thing.
...for me it might actually be a "cultural" thing. I'm from Norway, and in Norway it's illegal for companies to _claim_ that their products are the best, cheapest etc. So to me, whenever someone claims this - like in this case - my BS-instincts immediately kicks in, and I become very skeptical.
Sorry for the digression. :)
You can can find performance benchmarks here: https://txt.cohere.ai/launch-larger-embed-models#model-compa...
Cohere provides an API to access and finetune large language models (generative models like GPT and text representation/embedding models like BERT). These types of language models empower the majority of the latest developments in natural language understanding and generation.
Your feedback is well taken, we'll work to make these more reachable from the homepage.
For anyone who wanted more technical discussion re: ML / LM (though the author notes this work "[does] not reflect the architectures or latencies of my employer's models" i.e. it's an exploratory technical breakdown of general model characteristics) I've appreciated the technical write-ups from @kipperrii (ML ops @ Cohere) recently:
- Transformer Inference Arithmetic: https://carolchen.me/blog/transformer-inference-arithmetic/
- Breakdown of H100s for Transformer Inferencing: https://carolchen.me/blog/h100-inferencing/
Criticism is different from downright pessimism. I know founders and entrepreneur should have thick skin, but few people who could be potential customers or investors take these threads and the sentiments in hacker news as grain of salt.
Really appreciate the folks hyping up our team heheh
Also the feedback on the marketing copy being shit really resonates. We're going to be launch a refresh pretty soon which I'll make sure reads better.
It would be super helpful to me if some of you here would be willing to take an advanced look and just tear it up with some critical feedback!
Also anytime you have feedback about the product; like model quality, the experience of onboarding and using the product; etc. please shoot me an email!!
I'm at aidan.gomez@cohere.ai
Thanks again all!
NLP is going the same way as the rest of "cloud", towards managed services. Plenty of companies will roll their own ML models. If NLP is a core part of your business it might make sense to hire a machine learning team. If NLP is just one small feature that might be scrapped in 3 months after an A/B test shows negative results, using a managed service is a no brainer.
Cohere abstracts training and deploying language models for developers and companies that don't have an army of MLEs to collect billions of training tokens and figure out TPU/GPU training/serving of massive models.
Consider that BERT was published in 2018 and then put into mass production to power Google Search in 2019 [1]. For companies and devs other than big tech, the cost and required knowhow to put these models into production is staggering. Even deploying open source models (which we love) requires overhead in compute and knowhow. Services like Cohere lower the barrier for those who need access to this tech in a managed way.
Generation use cases often don't even involve user data beyond an input prompt. In embedding use cases, the user only sends the text they want embedded and get their vectors in return.
[1] https://blog.google/products/search/search-language-understa...
Edit: Cohere engineer here.
Any comparison to solutions from Hugging Face or John Snow Labs ?
I know these guys have been claiming SOTA for a few years and don't see how Cohere would be any more powerful, do you provide training ?
Language models trained on such data encode the hegemonic viewpoint; Jo and Gebru, 2021 detail issues and solutions around this topic in-depth. Enhancing the diversity of our training data is a top priority as we continue to iterate our data collection process.
(Source: https://docs.cohere.ai/data-statement#source-demographics)Hegemonic viewpoint?? Maybe I'm late for my mutual criticism session.
My own heros think I am nothing!