It doesn't need to be through the web UI, it can be done through the cli.
https://docs.aws.amazon.com/systems-manager/latest/userguide...
Google Cloud has a similar gcloud compute ssh instance-name command, and I imagine there's a similar one on azure.