It seems to understand a fair bit about themes and rhythm but it just cannot do rhyme. Something to do with the token encoding.