It’s what free speech looks like, whether you like it or not. 
The “but it will drive a lot of people away” is where attacks on free speech start.