I've found that having a dedicated WiFi hotspot mostly solves this issue, as long as you're somewhere with decent cell service.

I haven't tried it with desktop streaming, but VS Code remote development is a dream, even with little bandwidth.