289 karma · joined April 13, 2014
All this is awfully painful to manage with current frameworks and SDKs, somehow a weird mix of over-engineered stuff while missing the actual point of making things traceable and easy changeable once it gets complex (my unpopular personal opinion, sorry). So I have built something out of my own need and started to offer it (quite successfully so far)to family & friends to get a handle on it: Have a look: https://llm-flow-designer.com
So I started to actually build something to solve most of my own problems reliably and pushing deterministic outputs with help of LLMs (e.g. imagine finding the right columns/sheets in massive spreadsheets to create tool execution flows and fine tuning finding a range of data sources). My idea and solution which helped not only me but also quite a few business folks so far to fix and test agents is visualizing flows, connect and extract data visually, test and deploy changes in real time while keeping it very close to static types and predictable output (other than e.g. llama flow).
Would love to hear your thoughts about my approach: https://llm-flow-designer.com
Ultimately I’d like to extract information like date ranges, specific indications of tool usages (e.g. I have a bunch of data apis with their own individual data and semantic meaning which need to be picked and then a combination of tools to transform the data)
Absolutely terrible, no clear spec, absolute useless errors and/or just broken behaviour without telling what’s wrong. Reference implementations and frameworks are not working either, so only reverse engineering + trial & error until it runs, yaaay.
Feels like the early 2000 over and over again, trying to make something work.
But then you find an open source solution which is in general better and can do everything you want (simply tested already with just a docker compose up) but for deployment you get hit hard by compliance who just checks the SOC2 certifications and wants a in-depth due diligence of the code since everyone in the world can theoretically change it. Then your manager asks how it can be so good if it's for free and open source. And of course, last but not least, your overloaded team in general not happy to support just another unpredictable piece of software...
So it's the question to rather burn money and nerves with an awful SaaS offering and their endless and useless sales cycles and terrible and super expensive vendor-lock-ins or burn some money and nerves by utilising and running open source inhouse...
So typically I prefer to chose for the open source option and especially if the SaaS option isn't allowing me easy and fast self-onboarding, meaningful testing periods and a predictable and transparent pricing.
And then, if it get's widely adopted, I allocate some budget to support the authors and/or get some support plan (for more complex open source software) in place even though you most likely never need it...
Until then, Freestyle with Omnipod Dash in a close loop with iAPS was a game changer for me: Almost no peaks anymore, HBA1c on the level of a non diabetic person…
Nevertheless, good luck in productising it and I’ll be certainly trying it once it’s available…
A bit naive that, it’s too late since data is already mostly available and it just takes a different government to make this protection obsolete.
That’s why we Germans/Europeans have tried to fight data collections and for protections for so long and quite hard (and probably have one of the most sophisticated policies and regulations in place) but over time it just becomes an impossibility to keep data collections as low as possible (first small exceptions for in itself very valid reasons, then more and more participants and normalization until there is no protection left…)
I built a service (https://yasl.at) which allows to generate short url with customised meta data via a simple API to deep-link into web games and specifically results/things worthwhile to share without having the headache of tampering in each game over and over again.
You can read more about one of my use-cases specifically here: https://medium.com/@degola/supercharge-your-links-with-custo...
Open to do some backlinking @fayazara?
I’m used to store raw data I receive back from payment processing in my own database as transactional events (e.g. renew, cancel, successful and failed payments ) ends up as single events. I do the same for all application events and it is then rather easy for me to get the data as I need it for whatever KPI I want (activity, retention, usage) and for very little overhead while building products.
So I’m wondering, is this a result of all the low-/no-code stuff going on?
- Micro SaaS https://yasl.at, link shortening with custom meta data for link previews on messengers/social media, see my blog post for more details: https://yasl.at/dKpNnZ
- A web game called Wizencraft (https://wizencraft.com) which is a logic puzzle to guess the right order of items as quickly as possible which lets you compete with other players, solve daily challenges in groups and let’s you grind thousands of items, it's a very early alpha and I'm building it in public very iteratively and not polished at first, see more details here: https://yasl.at/XnoDtY
- And last but not least I started to build a not yet published simple dashboard for analytics where I can plugin my self-hosted database very easily. You can just write SQL queries for MongoDB, Clickhouse, Postgresql in a single YAML which defines the query and how a chart looks like on the dashboard.
The idea came from the fact that using other dashboard/analytic tools always is a hassle, existing analytics dashboards I used for products are not easy to copy, replicate or adjust and it's mostly doable solely via clicking in a complex frontend instead of defining it simply via a configuration and the available offerings are charging large.
I'm planning to have the chart definition editable via web interface and is stored locally as files which can be versioned and managed by git and can connected to the web interface with a simple docker container (this brings the analytics dashboard to the product source code itself and can be easily copied/adjusted again for new products). Happy to share more and once the first version of the dashboard is ready to use (in the coming weeks...).
---
Would love your thoughts on all of this and especially the analytics dashboard. Did you you face similar issues/problems with existing solutions (or if i can stop and actually use an existing solution which does what I'd like to have).
While it was somewhat difficult initially to make it work I managed to get over the last year to 85% in range continuously over weeks with a (for me in comparison to before) very low amount of hypos (3 or 4 per week).
Happy to share more and the challenges I had if someone is interested...
I have another very annoying issue with 3 screens which recover from energy saving after sleep slightly delayed and screw up my window positioning once in a while where all open windows end up on the main screen (I’m using spaces + a single desktop for all screens).
Does anyone know about a solution / tool here which rearranges windows on a previous saved state prior to sleep and waits until all screens are back detected before arranging them again?