Questioning one’s right to free speech is in itself an extremist view! So should we censor and ban your freedom of speech? Who decides which views are extremist? Therein lies the problem of your query… you are essentially asking how to maintain an iron fist over human thought and expression. The moment any authority figure decides that one thing can be censored and another thing cannot is the moment that authority figure has become a dictator, stealing away human rights.