What does
cat /dev/llama
do? Would I get a kind of LLM stream of consciousness? That's incredible :-) cat /dev/llama
do? Would I get a kind of LLM stream of consciousness? That's incredible :-)Our goal is to write a proper kernel module to implement three things:
1. a character device 2. 1st backend is a LLMZip ie you write to say /dev/l2ezip, you get a compressed stream out 3. 2nd backend is a LLM, ie you write a prompt to say /dev/llama2, you get a completion back
So the 1st backend could be useful for compressed telemetry The second backend could be useful for IoT LLM, or our ambitious plan of responding to telemetry, ie take action, such as control motor speed etc.