30B uncensored OSS model with no guardrails

huggingface.co

11 pointsthyrox5 comments

I wish they'd state the disk size of the models. Even the ones on GitHub don't have their file sizes listed, so you just have to cross your fingers and hope you have room.

The size is listed on the huggingface page, though if space is a concern you should grab pre-quantized versions anyway.

This model is somewhat obsolete at this point.

Oh I just learnt about it from a Yt video today. But that's great news if there is something even better!

Do you mind sharing a link to it?

"Censored" and "Uncensored" is kind of a red herring these days. There are like 1000 finetunes on huggingface that will have unspeakable conversations with you. New ones come out literally every day.

A few need a little poking in the prompt, that is all. Even base models like Llama and Mistral are basically unfiltered.

OpenHermes is popular one now: https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B

You can take a look at what others are hosting on the Horde for ideas/trends, as well as looking at communities like /r/localllama: https://lite.koboldai.net/

Personally, I am running Yi-34B-200K with an alpaca lora because its brand new, it fits on my GPU and it has a huge context size: https://huggingface.co/LoneStriker/Yi-34B-200K-4.0bpw-h6-exl...

Reply on news.ycombinator.com