Hi, author here -
GPT-2: a recent large language model (generates sentences conditioned on previous sentences)
LM: language model ^
PPL: perplexity (https://en.wikipedia.org/wiki/Perplexity)
KL: Kullback–Leibler divergence (https://en.wikipedia.org/wiki/Kullback%E2%80%93Leibler_diver...)