And yes, the LLM safety judge is not in general access right now. Still experimenting, and it is not being used by any customers currently.
35 karma · joined February 12, 2023
And yes, the LLM safety judge is not in general access right now. Still experimenting, and it is not being used by any customers currently.
I would also encourage you to take a look at our benchmarks (linked in the post), that show how the gaurdrails we have in-place allow us to deliver pretty strong results to our users. And as a last point, most of our users are not creating business-critical features with Vendo right now. For a lot of them, it is an additional feature that they wished they had but didn't. And for the companies we work with, the benefit of providing their customers with this level of customization outweigths the possible risk that you mention.
Would love to hear more of your thoughts, thanks for the feedback!
I think you bring up a good point though on how consumption of software will evolve (and the possibility of Claude just being the entrance to everything), and I think this is soemthing we have been thinking a lot about as well.
Agreed that agent harnesses as the primary interface is also a big possibility. From our conversations though, a lot of companies also don't want to lose complete control over the user experience. Which is why I think an increasingly more likley direction is every company having their own agent that functions as a "personal concierge" that gets stuff done for their usrs user and gives them what they want, but all under their own control.
I think it is a really interesting space in general, and looking forward to continue building in it!