I remember http://lamsonproject.org/ being a python SMTP server library thing. It may be possible to piece together something based on it. That covers the SMTP part.

Mind you, the git repo looks dead, with the last commit being over two years old.