Sendgrid has the worst IP addresses I ever used for sending email and the customer support has been even worse.
I agree, though. You need to pony up for a dedicated IP from Sendgrid to get good deliverability to many hosts. Small ISPs tend to be the worst, IME, where Google, Comcast, etc work pretty well with SG.