I can confirm that the bug exists in the Big Sur Release Candidate 11.0.1. This is a basic, dealbreaker bug for anyone who uses multiple monitors.

If you unplug an external display and then plug it back in, none of your apps' windows (which were on the external display’s Space beforehand) are visible or where they used to be. The external monitor’s Space usually appears completely empty.