Please please don't use greylisting. It's not cool. There are too many broken mail servers around and you'll loose emails. I was unfortunate enough that I had to use mail server with greylisting enabled. As a result I regularly lost booking confirmations.
Spammers know greylisting. Workaround is cheap for them. That's why you are receiving some spams twice.