Hacker News Reader

You can (and someone will) fine tune it away. There are datasets which are foss you can use on hugging face.

Or you can just wait, it'll be done soon...

You can but it'll never be the same as the base model.

That said it appears they also released the base checkpoints that aren't fine-tuned for alignment

Could you give an example of these datasets?

I think they should be easy to find (I never actually used one, but I keep on seeing references...) here's one