That's the Python interpreter and all the dependencies starting up. Shouldn't really matter if you are using it as a chron job.
I've never seen borg take 5+ seconds for anything except creating backups. The same `borg --help` command finishes in 0.4s on my machine. That's not blazing fast either but I'm okay with it.