You got it reversed. Bert is encoder only and gpt is decoder only.