We've been hearing security folks and constitutionalists make this argument at least since the Patriot Act. "What happens if one day, we don't have a sensible person as president and they still have these extraordinary (and usually extra-constitutional) powers?"
Like most sensible things, the criticism was brushed aside so here we are.