I agree that there was more that could have been done to signal correct orientation.
But an additional wrinkle is that the orientation of the port itself was not static. On laptops and desktops, it was horizontal. On certain other devices, it was vertical. Often these ports were in hard-to-reach or hard-to-see places, and having to reconcile the orientation in each case probably added to the frustration.