well, not the whole url, obviously, otherwise the router wouldn't know where to send the request
The entire URL is encrypted, the router doesn't need to know anything about the URL to route the packets.
The only thing that can leak when you make an HTTPS connection is the DNS query.
TLS server name indication can also leak your host, sadly.