I use offlineimap to get my mail to my local machine in maildir format, so no need for any imap etc in mutt.
Bonus: I can use tools like cat and grep etc on the emails.
Also, there's a lot of tools to have mutt imap support work with gmail/office365 etc.