The chat template adding an assistant prompt by default for example is also shown in the technical report - so they did this during training. The issue is inference workloads should not have this, otherwise inference workloads might inadvertently append extra assistant prompts or forget about it - so hence I removed it.

The rest I'm not sure - for eg the EOS token should be im_end and not endoftext - it could be a small mistake