For those reading this thread later, feel free to reach out with any feedback or questions marc at langfuse dot com
78 karma · joined September 6, 2021
marcklingen.com
Email: hi@
For those reading this thread later, feel free to reach out with any feedback or questions marc at langfuse dot com
(1) yes, that's what many of our users are doing while swapping might refer to changing model parameters, prompts, embedding stores, embedding parameters, or splitting a "layer" into multiple (parallel) steps. Alternatively when experimenting on a higher "layer", we often see wildly different implementations that are experimented with over time. We added version and release tagging which to build dashboards on the impact of these experiments on quality/latency/cost (currently in alpha, we will release it soon).
(2) I see how metadata propagation could be much more elegant via OTel. Currently the metadata fields on traces/span and filtering based on them kind of does the job but I see how it could be much easier to ingest and use. Thank you!
Do you have learnings on for which kind of project setups the migration works well and for which it struggles?
How/when do you plan to
- catch up on integrations other workflow tools have already built? E.g. my workflows often rely on data in CRMs/Notion/GitHub.
- integrate with alternative databases and datawarehouses? I don’t necessarily want to sync all state to the fastgen-managed Postgres.