I played around a bit and found out dropping the tokenisers version to 0.11.6 worked

`pip install tokenizers==0.11.6` first