The mistake was the trash can, they locked themselves in to a physical design that doesn't allow upgrading easily. Graphics cards come in different shapes and sizes.
If they had sold enough of them, there would be a market for Mac Pro-shaped graphic card upgrades. Swapping out the AMD FirePro D300 looks to only need a Torx screwdriver set, so certainly do-able by a user.