It doesn’t break text into chunks at all. These models can handle sequences of arbitrary length.