> I am writing this on a screen where the HDMI connector pops out if a even touch it.

Just one more reason to switch to DisplayPort. The only downside of DisplayPort over VGA is that it's up to the connector model if it locks, not user input; but other than that DisplayPort seems clearly superior over VGA. Apart from the obvious signal improvements, slightly more compact design and the recessed port, even an non-locking cable sits far more securely than an unsecured VGA cable.