I think you can use the VSCode Docker extension if you enable the Podman socket.