Podman also has a docker desktop alternative in the works (Already works on Mac IIRC)[0]. Will be interesting to see how these two solutions play out.
When podman will fix this issue (with sshfs like lima does?) I'll return to it
This works today, and works very well.