1M token is around 750k words, in English.
According to Wolfram Alpha that is:
Single-spaced document: 1500 pages
Double-spaced document: 3000 pages
Book: 1028 pages
So around 1-5 books.
I'm assuming they're using OpenAI's tiktoken tokenizer. (??)
According to Wolfram Alpha that is:
Single-spaced document: 1500 pages
Double-spaced document: 3000 pages
Book: 1028 pages
So around 1-5 books.
I'm assuming they're using OpenAI's tiktoken tokenizer. (??)
No comments yet.