Made me miss onenote...
2,712 karma · joined May 21, 2013
http://caffeineindustries.com - I am a full time firefighter/EMT that moonlights with Python and the web.
Made me miss onenote...
I don't look at any model the same after head to head comparisons with full precision and quantization at 4bit have run on my machine. There is little to no perceptible change with models of the same initial weight. BUT!!! I am now able to run models that required a DGX a few weeks ago on my home computer thanks to quantization. These models are better in every way from my POV. I am now more interested in what I can "do" with the models vs. just getting them to run. 30B at 4 bits is the sweet spot for my setup.
Second, I shopped around and found LG MH1 INR 18650 3200mAh HD 10A for under $5 per cell. So my 5S2P (18v 6AH+) battery with BMS and new case was less than $70 shipped with damn fine cells.
The cheapest knockoff amazon battery that works with Makita is about $50, but those are seriously sus in both cell type and BMS. Homedepot has the OG Makita 6ah at $200+.
The only thing you need contemplate for DIY is the quality of the BMS. Don't charge batteries when you are not paying some attention.
I'm really interested in finding a frontend with LangChain integration that can switch between chat mode and doc mode or something along those lines. It would be great to have a more versatile tool for communication and collaboration.
Do any of you have any recommendations or know of any projects that fit this description?
Do you have access to the models? It is being discussed all over the Discords and most seem to think getting access is not happening unless you are dialed in.
In the docs, the example pages have a nice 'configuration' dropdown. Again, this is very nice and I can see a bunch of 3D printing websites adopting this as a library. I mean, how many times have you seen a model that just needs a slight tweak to be perfect, but there is just too much friction (download, unpack, load, modify, resave, reupload).
On another note, I wonder if I can train a small LLM to the docs. Once trained, I would be able to have a conversation to create some really cool geometry. Hmmm...
How do I justify the purchase of DGX-1 as a hobby programmer? Call it my mid-life crisis purchase? I mean, its not that much more than a mid-range 2023 Corvette Stingray.
[0] https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni...
When the election was over, I went and collected a bunch of coroplast signs and have since turned them into all manner of things. My DIY ebike battery needed an enclosure as its a giant 13s10p from recycled laptop batteries. I folded up a old sign and used zipties to hold it together. Strapped it to the bike and Bob's your uncle... It works a treat!
A massive number of calls are simply untreated low-grade fevers where the patient was unaware of the fever. I am OBLIGATED and MANDATED to send them to the ED if they request transport. Furthermore, I am LEGALLY bound to offer transport to the ED. I have ZERO authority to tell them to take a fever reducer and call back if that doesn't fix their medical concern.
We are taught to use differential diagnosis in paramedicine. However, we are not allowed to diagnose per medical guidelines from the medical director. Working with this dichotomy has made the entire pre-hospital care system complete bullshit. Based on what I see in the ER, the entire system is on the precipice of complete failure. This collapse is unique and new due to the absurd volume of patients and bullshit policy that has not changed.
I didn't have pets growing up and my family bought my first dog at age 40. She has become one of my favorite things in life. She sleeps in our bed and we run together every other day. She smells like a dog and I love that smell. She cost $1500 which is an insane amount of money for a dog in my opinion, but we needed a dog that didn't shed as much. She is a golden-doodle, a bougie mutt if you will. I love her!
I work with hunters, ranchers, and other salty dudes/dudettes. We talk about what happens when pets need to be put down for various reasons. I have lost most of my empathy toward humans and prior to getting my dog, I could not understand why anyone would "waste" thousands of dollars on vets. I understand now, completely and 100% get why someone would not care if they needed to spend $$$$$ on helping their life companion. My dog has restored a bit of my empathy. The ranchers I work with are super detached from the herd, but boy are they willing to through hell for a good dog. I get it now.
*Its somewhere around $150 per month with food, medicine, insurance, treats, toys, grooming. Medicine for valley fever is very expensive, so we go to Mexico to get it... $140 vs $25 for 3 month supply.
Edit: As far as I can tell, the repo maintainers are far too busy writing code and creating to care what anyone does with the code. It will change 10 times in the next 8 hours.
For something that directly impacts myself:
People abuse the 911 system when they don't know what to do. Have a tiny water leak? Call 911. Feeling sick but lack any notion on what might be the cause? Call 911. See someone sleeping on the side of a business? Call 911. Get too drunk/high/angry/sad? Call 911. Bleeding (doesn't matter how much)? Call 911. Someone is shot/stabbed/burned/mamed/disfigured? Call 911. Car accident? Call 911. Doctor can't see you? Call 911. Doctor can't see you RIGHT NOW? Call 911.
If we could send everyone a trust worthy chatGPT that could calculate probabilities of actual life safety problems vs. the bullshit we mostly see. I posit the EMS system in America would be vastly improved. I can't tell you how many untreated fevers I see on a daily basis. A probability based recommendation of Tylenol and water could reduce ER visits by a significant percentage.
We are the defacto fire and medical insurance providers in metropolitan areas that employ/staff fire and EMS departments. Funded by property or sales tax, we have become the primary care providers for thousands of people in our cities.
We also get called for water leaks, hazardous spills, vehicle accidents, construction mishaps, swift water rescues, hiker rescues, venomous snake removal, bee attacks and dangerous hive removal, roof collapses, natural gas leaks, stubbed toes, fentanyl abuse, mental health emergencies, gun fights, knife fights, cooking fires, refrigerant leaks, trench collapse, people and things stuck in very high places, flash floods, electrical problems and much much more...
Playing around with it last night convinced me that LLM's are a huge, game changing technology. I was trying to decide which material to use for an upcoming project. The model doesn't use the internet without some hacking, so I had it write a program in python using the tkinter UI kit.
I asked it to create a UI with input boxes for material, weight of material, price and loss due to wastage. The program takes all of those inputs and converts the material into grams from KG, pounds, ounces. It then calculates the price per gram and takes a loss percentage (estimate given by user). It then writes a text file and saves it to a directory.
I literally pasted the code into VS code and had to change Tkinter to tkinter. Hit run and it worked flawlessly. I have NEVER used tkinter and it took about 30 minutes from start to finish.
This morning, I asked my 9th grade son what he is learning in 9th grade biology. He told me he is learning cellular endocytosis. I asked chapGPT to explain endocytosis like I was a 5 year old and read it to him... he says; "Ask it to explain it like a scientist now." After that he said it was a really good and we started asking it all kinds of biology questions.
I happen to agree that search will be the first thing disrupted. However, I think simply saying "search" doesn't come close to capturing how deep this will change the way we think, use and progress in terms of the way we define "search" right now.
I would also search for 'gridfinity' on printables, yeggi, and thangs. There are master collections that download into neat folders with thousands of options, pick a base, pick a few bins, then slice it up and print. Soooooo goood!
I organized our junk drawer in the kitchen with them and I was basically hailed as a rockstar by the family. we had these little baskets from ikea that did a decent job, but now we have dedicated battery storage, pencil/pen trays, thumb drive holders, odd/ends screws and bolts, etc. I am currently printing a jewelry system for my daughters earrings, rings and necklaces. I am relatively certain my wife will want one when she sees it in action.
It is a really cool system that solves some real problems for people like me who dabble in a ton of shit (hobbies).
Zach is hilarious if you ask me, I really enjoy his videos. His discord is very inclusive even for a very rough around the edges guy like myself, its not too in your face.
I see the competitors being a bit more flexible in regard to SoC used. There seems to be a plethora to choose from with different chips, but I am speaking from a very lay person POV.