Mostly the fact that they completely ignore accessibility.
In fact, if Twitter did want to improve the user experience, automatic OCR of such text and generation of the corresponding alt tag would be a practical improvement. In fact, general recognition of the content of an image and auto generation of an ALT tag would be a significant improvement.
... But that require them to do actual machine learning as opposed to being the internet's bathroom stall wall.