1,916 karma · joined December 14, 2010
The tool, which is documented here (https://mlx-optiq.pages.dev/) also implements the recently aanounced TurboQuant KV-Cache optimization, so in total this should greatly improve the quality of locally run LLMs.
Looking forward to an OptiQ release of the Gemma 4 family.
Along the same line is that you can watch any hour long video without interruptions unless it is music where you will get interrupted every couple of minutes with "are you there?" dialogues.
The European and especially German approach of regulating pre-emptive might be more fair, but apparently it also stifles innovation, as we can observe. Almost no significant players from Europe and Germany.
Instant reactive reproducible app that can be sent to others with minimal prerequisites (only uv needs to be installed).
Such a hot combo.
Have not used shllm, but from the docs it looks good. Clipea and others have not been updated for quite some time, except llm from Simon Willison, the datasette developer. His llm implementation has a llm-cmd plugin which provides what shllm does. Works like a charm.
Over all a very useful category of AI programs.
I miss the state of flow very much, not being able to focus on one thing and diving deep for a couple of hours or even a couple of days. The constant context switch and firehosing of incoming messages I have to fend off is draining.
Just as you say, some days feel like having been completely busy while not achieving anything of substance. I know I am lubricating others work, but I'd love to be with my own toughts for a while also.
For the next project I am attempting to dedicate full and exclusive days to the different contexts, so that at least on that single day my mind is not concerned with all the contexts, threads and their TODOs.
I am already tagging my incoming emails with "TODO" and "waiting for reply" and sorting them into their respective folders and then afterwards heading for the tag stacks and working on them. I think I will add tags for contexts and set up filters, so that I can open the right TODO stack for the topic of the day I am working on, to conceal any "not today" work.
Pair it with the Gemini protocol and you're there: https://en.wikipedia.org/wiki/Gemini_(protocol)