Really just the grammatical correctness in the generated text (pronouns and possessives). Early versions produced awkward sentences when the model guessed incorrectly. It is a good point I didn't think about regarding making it optional to input.