To delete a tag simply click "File" in the notes list of the selected tag. I've had this question come up before so I think it's time for a clearer way.