Accessing the Applications section also prompted for a password when I tried over the weekend. Either there was more than just the Public Keys that required re-authentication or this was indeed around for longer than just a couple minutes.
This is a separate issue. We just added the Private Token feature on the /settings/applications page. This is essentially a password, so we wanted to make sure that it required password confirmation. This will be behind sudo mode later today hopefully.