This is akin to the common "I'm not racist, but" or "no offense, but".