HNHacker News
TopNewBestAskShowJobs

cgorlla

153 karma · joined April 29, 2020

submissionscomments
cgorlla··on Launch HN: Mentat (YC F24) – Controlling LLMs with Runtime Intervention
>yet, the way you described your method, it involves modifying internal model activations

It's a subtlety, but part of it works on API based models, from the post:

"we combine this with a graph verification pipeline (which works on closed weight models)"

The graph based policy adjudication doesn't need access to the model weights.

>Could you bake the activation interventions into the model itself rather than it being a runtime mechanism?

You could via RFT or similar on the outputs. It functions as a layer on top of the model without affecting the underlying weights, so the benefit is that it does not create another artifact for a given customization.

>What exactly are you serving in the API?

It's the base policy configuration that created the benchmark results, along with various personas to give users an idea of how uploading a custom policy would work.

For industry-specific deployments, we have additional base policies that we deploy for that vertical, so this is meant to simulate that aspect of the platform.

cgorlla··on Launch HN: Mentat (YC F24) – Controlling LLMs with Runtime Intervention
Indeed, we had a huge influx, should be back up now. Thanks for pointing it out
← PreviousPage 2 of 2