ParentFull threadthesz·BPE that is used in tokenization is very simple: https://en.wikipedia.org/wiki/Byte-pair_encodingView on HN