That's a good question - I was initially thinking that it was pretrained from scratch using the Llama arch, but https://github.com/canopyai/Orpheus-TTS/blob/main/pretrain/c... implies the use of 3.2 3B as a base.
> the code in this repo is Apache 2 now added, the model weights are the same as the Llama license as they are a derivative work.
https://github.com/canopyai/Orpheus-TTS/issues/33#issuecomme...