Hacker News Reader

We’ve actually been building a testing and evaluation platform from the start, but started with discriminative ML tasks like classification and regression. We waited to do a Launch HN because we were mostly focused on enterprise / mid-market.

These past few months, however, we’ve prioritized building out features for testing and monitoring LLMs.

LLMs certainly have their unique challenges, but the evaluation problem in general is not new, and much of what we’ve built historically is very much applicable to this new crop of ML use cases!

There is nothing wrong with pivoting

Another YC pivot to ai from yesterday: https://news.ycombinator.com/item?id=38516795

Nothing wrong with pivoting. Or maybe i'm misreading you and the parent's "tone".

Agree with nothing wrong about pivoting, mostly an anecdotal point wondering if there is going to be a trend of this for YC companies.

I do wonder if non-ai talent pivoting to AI is wise or defendable. Do you want to use a service where the creators don't really understand the tech and are not much more than a wrapper around an API? Is that really a defensible posture in a competitive market?

We will see. I'm sure some will hire talent and have the data to do something special.