And if you read the rest of that mailop thread, you'll see that the broader IP reputation of the /24 where your IP is located is a key part of whether or not your email gets delivered.
I would venture to guess that a substantial portion of people reporting issues delivering at small scale are sending from a low-reputation netblock. (Assuming auth is all set up optimally.) So it's not that it's not possible to send at low volume, it's just that most people don't know to look at the netblock, it's hard to evaluate netblock reputation, and it's not always possible to select a preferred netblock within a given provider (especially VPS providers with low-cost options).
The bottom line is: it's hard to run your own mail server, and much of the reason for the success of services like Sendgrid is a) it's easier to set up auth properly with most of them, and b) they actively manage the email reputation of their netblocks (though some do this better than others).
If you're approaching things from a practical perspective instead of making this your hill to die on, you just use an email service provider, and for the vast majority of senders, life is a little bit easier. There's plenty of ESPs to pick from, and there's a very good chance you can find a free one that delivers better than an average VPS or IP of a residential ISP.