Just found out that there's an extension to use Docker/Podman within VSCode which works on a local or remote machine.

https://code.visualstudio.com/docs/devcontainers/containers