The close button has always been there, you double clicked the top left menu button. That worked all the way until Microsoft started redoing window decorations in desktop mode with Windows 8.1, and even for a short period after.
This was also copied into other X window control styles. Even today, a Motif replicates the Windows 1.0-3.11 top-left menu+close button.