I recently wrote a writeup on bigrams and the infinigram outputs[1]. I genuinely believe that ngrams are making a comeback. For query searching it's really good.

[1] https://snats.xyz/pages/articles/from_bigram_to_infinigram.h...