theodoretliu

I can think of two possible approaches 1. Jev limits to 255 distinct options. So they can preprocess your set of options and “tell” the LLM via input tokens 1 = red, 2 = blue, etc then jev need only output softmax over 255 states while benefiting from pretrain of other LLMs 2. You allow the forward pass to output over the total token state but mask over the logits to limit to the user options. Less plausible? bc tricky when input is multi token which they clearly support.

My guess would be option 1. Didn’t read the kev repo here which would also explain

Pocketflows | Founding Engineer | San Francisco, CA | In-person | $170k-225k + equity | pocketflows.com

At Pocketflows, we’re on a mission to help Main Street SMBs grow. We build marketing and communication APIs that embed inside the vertical SaaS platforms that businesses like salons, fitness studios, and restaurants already use to run their operations.

As a founding engineer, you'll be launching new marketing products in addition to our existing email, SMS, and review platform.

Our values blend ambition with kindness and empathy.

Stack: Ruby on Rails, React + TypeScript, TailwindCSS, Postgres, Redis

Interested? Email us at team@pocketflows.com with your resume/LinkedIn/GitHub, a note on why you'd like to join, and an answer to this riddle:

"I'm thinking of a secret number hidden on pocketflows.com. I won't console you if you can't figure it out"

Pocketflows | Founding engineers | Full time | In person - San Francisco, CA | www.pocketflows.com | Comp: 180k - 225k

Want to build AI that will impact SMBs in real-life industries that power the backbone of our economy? Come join Pocketflows - we help SMBs grow by offering a marketing platform embedded inside the software they already use today.

We've signed on and launched with incredible SMB platforms. You'll have the opportunity to build important workflows that help hundreds of thousands of SMBs

Founders have prev built out both frontier marketing products (Qualified) and embedded API products (Stytch, Gusto Embedded)

We’re both from the midwest and are huge believers in main street businesses (our end users at Pocketflows). Long before our tech careers started, our first jobs were at mom & pops' in our hometowns!

Well-funded by investors who believe in our mission and SMB tech, and an incredible network of angels & advisors who have built and scaled SMB tech platforms

More info here: https://ext-pocketflows.notion.site/

Was loving the ease of deployment on render but had to move off for lack of BAA and HIPAA compliance. Any timeline for support?