The Republican Party also fought slavery! But, in the 1960s and 1970s there was a realignment in American politics where the GOP pursued white votes by opposing desegregation and civil rights legislation. 

This does not in any way mean that all Republicans are racists, or any particular Republican is racist. But most racists are Republicans