Indeed, it has a lot of limitations. It's better to use docker compose with a podman socket.
I'll try to do some more testing between the two and edit my original comment with my findings!
After all the whole point was supposed to be that it didnt need a daemon.