Not necessarily ruling but definitely highly privileged. You definitely could not just travel on a whim inside the USSR. You needed special permission from the government, which was most commonly (but not exclusively) given to people whose job depended on travel.
The restrctions might have been somewhat more relaxed in the middle of nowhere in Asia, but they were extremely strict for example in occupied Estonia where I'm from. You couldn't even travel inside the whole capital city of Tallinn, even if you yourself lived there. The city was divided into zones and there were border guards protecting these zones. You can only go to a zone that has a shoreline when you directly reside there. Otherwise you might try to escape the utopia. -- The restrictions of course go way beyond just Tallinn. Want to visit one of the 1500 islands of Estonia? Too bad, not allowed unless you live on the specific island. Want to just explore the countryside? Might be somewhat possible, but better be careful not to get close to any of the secret closed cities or any of the numerous missile silos, unless you want to be labled as a threat to the USSR.