72 karma · joined November 1, 2016
The setup I had to do was important and I had to compile koboldcpp with a few special params for my hardware, I mostly just had Claude figure it out. I don't remember everything I did now but it was very slow and would often stop mid task, it seems it was mostly a parsing issue. It made the model seem broken/dumb, but once I had all that settled I actually am able to use this how I use Claude Code. Disclaimer, I am pretty explicit with requirements, I imagine this fails more when you leave it to figure out things on its own but for my flow its pretty rad.
Currently setting it up as an automated agent now to pull Trello cards, create PRs for them, and move the card to be reviewed.
Command I am using to run: python koboldcpp.py \ --port 61514 --quiet --multiuser --gpulayers 999 --contextsize 262144 --quantkv 2 \ --usecublas normal --threads 4 --jinja --jinja_tools --jinja_kwargs '{"enable_thinking":true, "preserve_thinking":false}' \ --skiplauncher --model /data/models/Qwen3.6-27B-Q5_K_M.gguf --smartcache 5
I mean... we are just monkeys. Did we not learn this way when we were younger?
I have had a number of times I just don't remember a moment, only for a friend to show an old photo they happened to see again and a flood of good memories come back.
For instance I was going to build a complicated job system to handle payouts to different company locations, but I realized that until we get thousands of customers I can just send the payouts manually by clicking some buttons in Stripe. A bit tedious but instead of building and debugging that we now have another full feature built out improves our users experience.
The booking and paying online is actually just a small portion of the needs most of these businesses have. In addition to appointment management we also handle keeping track of customers, customer's pets(vaccination requirements, dietary needs, etc), inventory management, employee scheduling and role management, and analytics for it all.
Our competitors seem to handle parts of these but we are looking to be an all encompassing solution while simplifying the UX. We are also targeting multiple location support for enterprise customers, with our competitors multiple locations seem to be an afterthought. On top of that our app is faster and cheaper per month, offering discounts for multiple locations and no setup costs (other than buying optional hardware).
The market has a lot of competition, but it seems most solutions are just too bulky and slow. We recently went on a trip to various boarding places around us and received good feedback about our product. I'm very excited to see what happens next.
I think that getting the controls right is what will matter the most in the end. Until then the game will go no where.
"Once trained, our system is also extremely fast and compact, requiring only milliseconds of execution time and a few megabytes of memory, even when trained on gigabytes of motion data."
> Postal was developed by aTech Media to serve its own mail processing requirements and we have since decided that it should be released as an open source project for the community. It was originally launched by us as AppMail but renamed to Postal as part of making it open source as we felt the name was more suitable.
When I started development WebRTC wasn't very well supported, now I am considering using a hybrid. I already use two websockets, one for binary state snapshots and the other for JSON important updates like entity creation and chat. It would be interesting to implement WebRTC to my servers just for the state snapshots.