IMAP just download the index, not the content.
When you click on an email - then it'll download that email. Attachment is also probably you have to click it too.
That's just not feasible when you (turned out to have) nearly 150 K emails in your Gmail account.