I'm highly interested in doing the same, can you recommend any resources that describe the process of setting up a self-hosted mail server?
Here is one with virtual domains, etc. might be overkill for your usecase though.
http://workaround.org/ispmail/squeeze
I personally run a stack over courier and some other hacks ontop of rdeliver, which works really nicely.
Important: Please always make sure to check that you don't run an open relay.