Storing the name of an "environment" in an environment variable and then using that to pick the appropriate configuration file is what .Net Core does for web apps and that seems to work fairly well.

Then, of course, you have the fun of Azure Application Configuration and KeyVaults - which are fine once set up and your app is happy with them.