It's also like the phrase, "I'm not racist but .." which is almost certainly followed by a racist statement.