The default is Archive, just like Google Hangouts but you can delete conversations by clicking the Cog icon on the thread.

I think I saw that option before. I know I definitely can delete messages and they don't appear in the download.