The tokens are immediately transformed into embeddings (very large vectors), so the 17 bit values are not used for any computation.