I use sudo -A with some openssh ui for sudo. I tell the agent to use sudo -A for anything that it needs and then it pops up with a sudo password prompt.