tsadoq

68 karma · joined November 14, 2024

submissions comments

tsadoq··on Mercury Coder: frontier diffusion LLM generating 1000+ tok/sec on commodity GPUs

It looks super cool, any plan on open sourcing something? Btw, looking for an AI solution/sale engineer :P

tsadoq··on Show HN: I Created ErisForge, a Python Library for Abliteration of LLMs

L’alleato was the name given by Eris to the Golden Apple of Discord.

tsadoq··on Show HN: I Created ErisForge, a Python Library for Abliteration of LLMs

Not necessarily true, one quick pass might be needed but quite not as devastating as it might seem

https://huggingface.co/blog/mlabonne/abliteration#%E2%9A%96%...

tsadoq··on Show HN: I Created ErisForge, a Python Library for Abliteration of LLMs

That's a wonderful repo that I used as my starting point! The main problem with that one is that it supports only models that are on transformerlenses and unfortunately they are not a lot...

tsadoq··on Show HN: I Created ErisForge, a Python Library for Abliteration of LLMs

The other link is quite good, i also suggest this for some practical application

https://huggingface.co/blog/leonardlin/chinese-llm-censorshi...

tsadoq··on Show HN: I Created ErisForge, a Python Library for Abliteration of LLMs

please give feedbacks! It's quite a raw first implementation and would be very nice to have suggestions and improvements.

tsadoq··on Show HN: I Created ErisForge, a Python Library for Abliteration of LLMs

> Do these techniques train models while performing the modifications?

Depend on what you mean by training, they change the weights.

> Do these techniques train models while performing the modifications?

I'm not sure I understand, but there is an example of performing an obliteration on gemma to make it never refuse an answer. It's about 10 lines of code.

tsadoq··on Show HN: I Created ErisForge, a Python Library for Abliteration of LLMs

as someone that studied mainly acient greek and latin in high school, I tend to have quite a limited pool of inspiration for naming what I build haha.

tsadoq··on Show HN: I Created ErisForge, a Python Library for Abliteration of LLMs

planning to update it to be able to run on it. It's just a matter of finding the keys in the layer dict of the model.