For this particular feature I like my own home rolled solution where I automated the process of spinning up a tiny ec2 server with an nginx proxy to a reverse ssh tunnel that goes back to my local machine. It gets a letsencrypt cert and modifies the route53 dns. All managed with a cli command and config file.
The other benefit is that it is completely unthrottled, which is particularly useful if your debugging some stupidly large react/vue website.
Im working on a feature that will enable basic-auth in front of it also, so at least a password would be required to send traffic to your local machine, if you wanted. Good for the "share your work" sort of scenarios.
tl;dr if you want any-subdomain.your-domain.com -> localhost:port, and you use AWS, try https://github.com/nelsonenzo/tolocal