Yeah, I've only had this happen a couple times, and it does make you trust your spam system less.

That being said, it's seems to be getting better as more companies embrace SPF.