I would say the secret management part typically isn't the most insane or annoying part.

For me it's external system state management. Like making sure the integration test db is cleaned up correctly.