Comment by unshavedyak | Hacker News Reader

Comment by unshavedyak | Hacker News Reader

Parent Full thread

On the plus side i think at-home LLMs will continue to get a lot better. ChatGPT 3.5/4 both seem in reach for Llama2 and seeing all the amazing fine tunings that were available for Llama1, i suspect we have a very functional future of at home LLMs.

I say functional because i don't think we've seen the larger reasoning skills scale well for smaller deployments, so that may be out of reach. But i think a future were we run something far better than Siri, entirely at home, hooked up to our home APIs in a functional spoken interface seems in reach and awesome (to me hah).

I look forward to hooking all my at-home cameras up to a voice recognition, image recognition, and LLM detection suite and just speak aloud and have the AI-suite "do stuff". It sounds really, really fun to me.

If it's cheap it'll be slow, but imo that's okay. For home use i think these systems can be the glue that tie our DBs/Ingestions/etc together, rather than the big-brain that knows everything.

Except for the part Llama 2 weights are still being gated by Meta. There are certainly ways around this, but officially this hasn't even changed, even for Llama 1. I'm not certain Meta has any real incentive to do so. This arguably puts a bit of a damper on home solutions.

Falcon looks very promising, but we seem to be at the early stages of its release, and I haven't seen much validating the claims made about it.

I'd love to host an in-home alternative to Alexa, but I don't think I have the time to train a replacement on my own. Here's hoping this changes

"I look forward to hooking all my at-home cameras up to a voice recognition, image recognition, and LLM detection suite and just speak aloud and have the AI-suite "do stuff". It sounds really, really fun to me."

Alternatively, this sounds like the starting plot to a crossover sci-fi/horror movie...

Of course it does. That's the structure of all sci-fi horror https://dresdencodak.com/2009/09/22/caveman-science-fiction/

They never read Demon Seed.

The door refused to open. It said, “Five cents, please.”

He searched his pockets. No more coins; nothing. “I’ll pay you tomorrow,” he told the door. Again he tried the knob. Again it remained locked tight. “What I pay you,” he informed it, “is in the nature of a gratuity; I don’t have to pay you.”

“I think otherwise,” the door said. “Look in the purchase contract you signed when you bought this conapt.”

In his desk drawer he found the contract; since signing it he had found it necessary to refer to the document many times. Sure enough; payment to his door for opening and shutting constituted a mandatory fee. Not a tip.

“You discover I’m right,” the door said. It sounded smug.

From the drawer beside the sink Joe Chip got a stainless steel knife; with it he began systematically to unscrew the bolt assembly of his apt’s money-gulping door.

“I’ll sue you,” the door said as the first screw fell out.

Joe Chip said, “I’ve never been sued by a door. But I guess I can live through it.

-- Philip K. Dick, Ubik

The 5 cent reference has a history in Boston, it’s why the mbta card is called the Charlie card:

https://youtu.be/MbtkL5_f6-4?si=IQZrPJhDWhNVyhx_

More like "the door misunderstood and thought you said something racist, your account has now been terminated and doors disabled"

Literally any new technology could be the plot to a sci-fi horror movie. The entire concept of the genre is to show how progress could go awry.

Reply on news.ycombinator.com