66 karma · joined September 17, 2021
thinking a native connection to cloud auth managers is the best way to do this (clerk, auth0, etc.)
we chose typescript because it's the most token efficient way to pass types and signatures to an LLM, with Python and Pydantic there are extra characters passed around
on your second point, check out how we lock down the sandbox with a custom deno runtime! https://github.com/portofcontext/pctx/tree/main/crates/pctx_...
on third, will def get some benchmarks out... we setup OTEL so we have the data
1. Security/packaging problems. Security problem is self-explanatory, and for packaging binaries in SDKs we ran into a lot of issues with languages that don't have first-class support for binaries. It was particularly problematic in golang. 2. Iteration time: waiting for a cross-compilable binary each time we wanted to create a new SDK was a huge testing issue. we needed to build in a way that let us test our outputted SDKs in seconds rather than minutes. we now have a testing pipeline that runs in less than a minute on a bunch of live APIs
so we've gone with an approach that uses a combination of custom macros + templating
And yes, language-level docs will be implemented. So far we've found that our users are happy with using the snippets in the docs + autocomplete from typing in code editor. But for advanced use cases I definitely see the value in language-level docs.