DevRel at HuggingFace
dx.tips
dx.tips
tldr: old benchmarks saturated, methodology was liable to a lot of subtle biases. as she mentions on the pod, they're already working on leaderboard v3.
This is such a great piece.
Phase 1 - Launch product which loses money
Phase 2 - ???
Phase 3 - Profit!
Few have progressed past the first phase yet.
I remember seeing a post last week-ish from Julien Chaumond that they are profitable.
They are selling related services. Looks like data and inference offerings with per seat pricing. https://huggingface.co/pricing
My business model was that people with great models trained on proprietary data sets would buy & sell trained weights and fine tuned models for private use.
Here is an example.
No e-commerce business is going to easily publish their sales data for everyone to train so they can build a great model for optimizing recommendations of products.
Hiring an internal AI team may have 2 problems.
- It may cost too much - May not work as well - You may not have the appropriate data set or data size (DL is very data intensive).
For a small fraction of what it may cost to hire your own team. You may buy a fine tuned models or readily trained weights that you just "plug & play".
That sounds like reasonable model.
The client (e-commerce) saves money, time, is guaranteed success, and gets the bonus productivity output from AI integration.
What do you guys think? Tarpit idea?
If I owned hugging face, I would follow such a strategy.
And I truly mean that, whether PM/TPM/or even SDM/SDE. The common denominator is they were always absolutely useless, adding no value or no true technical contribution, and their only value add was siloing information and claiming to be in "meetings" to lead some effort forward.
Their entire job function could've probably been replaced by a wiki or Google Doc. They intentionally made themselves the only points of contact and did not introduce people cross team because people would probably immediately realize how useless they are.
I've seen this multiple times, multiple roles, L5+, earning 100s of thousands of dollars a year at big tech companies.
Yes, I will waste 45 minutes of my time explaining word for word to you, exactly what is written in this design document, and none of it will be documented, no AIs will come from it, so you can look "busy" for today and tell your manager you did something. Woohoo collaboration!
Simply put: they use the information they gain to justify the utility of individual team members to the overall effort and thus the proportionate compensation.
Then your individual contribution and performance determines an additional +-10%.
And they will misunderstand you, turn around and butcher the explanation to some higher up, indirectly claiming credit for your work as the messenger of its result. If something goes wrong with the project, they'll definitely make sure to emphasize your involvement in the failed initiative, strategically distancing themselves.
Where the problem exists is when the systems and processes business use start to become calcified into the organisation's way of working, and compliance is used to control the work people do.
RACI, RASCI, DACI as an example are all fine mental models for thinking about how people or teams should work on a project. But if I'm planning a project and propose a DACI, and then my project ends up getting derailed because some other manager thinks we should use a RACI instead it's probably game over.
Having a team of thoughtful and professional self-directed learners and creators sounds amazing if you can get a space for a team to come together around it.
Companies that have to, or choose to compromise on their labour force, either from a competency or salary perspective often have to put more supports in place to keep people longer.
Doesn't mean OKRs, etc are the correct solution.
I'm an Engineering Manager these days and I suspect this is true to an extent for my role. All I seem to do is relay information from one group to another, translate from one jargon to a different jargon, figure out who to talk to in order to get someone to be able to push a button, and, more often than I'd like, sit in meetings and remember things when someone else has forgotten. If my teams and the teams they work with wrote things down in discoverable and organized ways I would be out of a job.
However, due to the fact my teams are made up of fallible, disorganized, and very human people, my job seems pretty safe, and I get a great deal of satisfaction from knowing I help a lot of people get a lot more done than if I wasn't around.
When I became an engineering manager I invested a ton of effort into providing solid documentation where people expect it: Swagger docs with real examples for our RESTful services for devs, confluence documentation for wider audiences, various guides and FAQs, and even in-repo ADRs. It probably saves us about 15 labor hours of meetings a week and maximizes my team's hands-on-keyboard time and minimizes interruptions.
The weird part to me is I’ve worked with PhD folk, DARPA hackers, FAANG folk and they were so kind to me even when I said dumb things the person on the other hand was just idk how to describe it made coding just painful idk why though to this day
Is this what caused the title to be "300%"?
a. that's actually ~200%
b. isn't growth, as defined by number of repos (which might be free) the wrong metric. It's super is to scale adoption when you're giving something away for free
For anyone else that got tripped up... 1x to 3x is 200% growth because you don't get to count the original 1x
"The number of cores in the PC went up by 50%" means "there are now 1.5x as many cores"
However, "the number of cores in the PC is 50% what is was last year" means "there are now .5x as many cores"
In this case 200% is fairly unambiguous, but imagine a phrase like "scaling community 50% per year" which could mean different things depending on the direction of the scaling... I think it's more intuitive to use a multiplier: "scaling community 3x bigger per year" makes it easy to visualize an online community tripling in size every year.
IMO I prefer the former ("growth factor") calculation to the "growth by" calculation as it's simpler, it's just [the_percentage]/100 * current_value
in the other case it is (the_percentage + 100)/100 * current_value which takes an extra CPU cycle of my brain
update: dead serious. I searched. It says "objectives and key results." But what does one look like? Is it a document?
Can be a document, an app, whatever. One flavor is objectives are set at the top, their KRs are translated into objectives for the next management layer with their own KRs, and so on. It's an iterative process with some combination of top-down and bottoms-up activities. And afterwards, the results are reviewed. There's more to it, but that's the gist.
An example: an objective might be "improve application performance". The key results for that objective might be "reduce average page load time from 3s to 1.5s" and "reduce API response times by 60%".
Ah, I see. It bubbles. Explained by https://news.ycombinator.com/item?id=40979799
Thanks everyone.
It's actually a very solid framework, but as the many comments indicate, poor implementations abound (also see Agile, DevOps, etc).
Youre currently only supporting jpeg and png.
Your objective for a quarter could be to broaden support.
So you'd plan to add 10 additional formats. If you add 8, you've achieved your goal. Makes sense, right?
Honestly, the snide comments are spot on. It was even dumber then SMART SCRUM, aka development via waterfall, which is totally agile xoxo
>So you'd plan to add 10 additional formats. If you add 8, you've achieved your goal.
My plan was to add 10, and I added 8. I achieved my goal?
But, most of the places I've seen doing "OKRs" are just appropriating the word but not the actual system.
I still don't like it.
So for example, if you worked in online retail like I did, maybe you'd get an objective like that and then hypothesize a few things along the lines of "if we increase product image interactions by X% then sales should go up by Y%." as key results that you then report back out to management to show progress towards your objective.
Not trash talking them, just agreeing that there are other factors.
> Why is it X and not, y'know, X?
Is there something central to what a business is besides the way communication happens within it?
Step 2: Do almost anything you will still grow.
Not to say this way of working isn't good, but HuggingFace's success is not a great data point to validate the hypothesis.
Step 2: Cash it in and make a lot of money.
Yup exactly. We call that venture capital
https://en.wikipedia.org/wiki/Developer_relations https://en.wikipedia.org/wiki/Technology_evangelist
Kind of, that's not a bad analogy really. It's like if Jen knew what CI and observability were (huge over simplification but you get the idea).