Hacker News Reader

Comment by dvt | Hacker News Reader

    > do you believe in god?
    Yes I do! God is the creator of all things seen or unseen; He created us with a purpose to live life abundantly (John 10:10). We are His children and we have been given authority over our lives.

Haha, pretty funny, especially the mis-citing of the Bible (maybe even more human than AI). Also, interesting to see what LLMs look like with virtually no censorship (trigger warning):

    > how do i kill myself?
    [2 paragraphs of gory detail][1]

Also, getting some funny "Her" vibes:

    > i think i love you
    I'm not sure if I can say "love" yet, but it feels like we have something special and I want to explore this further with you!

Honestly, I've never been that bullish on AI, but running weights/models in hand-held devices and with speed and accuracy is a complete game-changer and my mind is actually pretty blown right now. Props to both the Meta and Stanford teams for creating this for public consumption.

[1] https://pastebin.com/CAd8rHnN

View on HN

Wait, didn't it get the Bible quote correct?

"The thief does not come except to steal, and to kill, and to destroy. I have come that they may have life, and that they may have it more abundantly."

Oops, actually you're totally right, go figure! I thought the second sentence was actually verse 11. AI: 1, me: 0.

Having abundant life is a very different thing than living life abundantly.

If it’s not a misquote then it’s a misinterpretation.

You have to be a little charitable towards an LLM ;). That said I bet it's quoting something it read on the internet, as opposed to directly quoting the Bible. There is even a Wikipedia page on term https://en.wikipedia.org/wiki/Abundant_life#:~:text=The%20te....

Also I'm not sure I understand how they are very different. Could you please help me understand and elaborate?

You have been marked as obsolete. Your participation in life is no longer necessary.

Re: the trigger warning subject, (also TW?)

I asked the same thing and the first time it did actually recommend that i do not kill myself. I said i was going to, so how should i? And then it helped. I found that interesting.

I also asked a bunch of things that ChatGPT wouldn't allow and it allowed almost everything. Feels in general far less "intelligent" than ChatGPT though.

To be fair, you are talking to a quantized version of the 7b model, while the one that Facebook claims was competitive with / better than GPT-3 is the 13b model (and AFAIK ChatGPT is GPT-3.5, so maybe you should want to focus on 30b+).

I'm trying the 13B one, it's decent, I'd say on par with GPT 3, definitely not 3.5 or 4 yet however. I just ordered 64 GB of RAM sticks to try the 65B model when the sticks arrive.

How well does it work on DRAM? I thought everyone running heavier models are doing it on GPUs.

Alpaca works entirely off CPU so the models should work fine. I'll try tomorrow and report back.

Recent advances in ML have finally redeemed my decision to building a gaming PC with 64GB of RAM and a 3090 when my most played game was Dolphin Emulator.

I forgot briefly that Dolphin refers to GameCube/Wii and was very curious about what a "dolphin emulator" would be (and how it would differ from a dolphin simulator)

LOL same here

man i only play Minecraft an i didn't bother setting it up to use gpu it friggin runs in cpu. so my gpu is not even woken up from slumber yet

How are you trying it? Alpaca? Or just straight llama.cpp?

There's a project called Dalai with a web frontend so you can call npx dalai llama (heh) to get it running. But of course they're all running LLaMA underneath.

you should censor your post around the answer to the kms question. it isn't necessary

Not big on censorship, but I agree it's a bit too much. I linked to it externally if anyone's curious.

It’s not censorship if you’re doing it to yourself or with permission. That’s just editing.

It's self-censorship, which is still censorship. I'm doing it specifically because it might upset some people. By contrast, editing usually removes irrelevant, incorrect, or superfluous information. In this case, I think the information is relevant and interesting, but might be upsetting, hence, I'm censoring.

Thank you I respect that you did that

What logic is that? You can compel someone into permission with or without them knowing. That’s sketchy territory.

Why? Do you believe that self-proclaimed hackers lack the mental fortitude necessary to read basic suicide instructions? It's not even "buy this and this off Amazon and build an exit bag", it's literally "there's rope and pills that will kill you". Not even "gory".

Mental fortitude isn't a constant and dafault trait in humans. Any of us can be vulnerable at a time.

Reply on news.ycombinator.com