"Whoever the president is, they have to have somebody they know and trust and somebody the administration trusts. That person is not going to be me."