I feel the same way. Free speech is meaningless if it has exceptions. Nobody objects to speech they agree with, appreciate, or are indifferent to. Free speech only matters in relation to speech you personally disagree with, don't like, find offensive, or feel threatened by. 

The thing about speech, and what makes free speech not only ideal but essential, is that it's... just speech. Not matter what the speech is, the words don't actually do anything. They're just words. If you don't react to the words, it's as if they never happened. Life goes on. 

And it's perfectly fine to disregard speech. You don't have to read a book you don't want to read. You don't have to have a conversation with someone you don't want to talk to. You can literally ignore every word they say, or just turn around and walk away. They can scream at you, and nothing has actually happened. You can just keep walking. 

That's how I personally feel. I find the concept of "hate speech" unrelatable. 

And all that applies ten times more online, where the person is somewhere else on the globe and not even close enough for any possibility of actual harm occuring. You can literally close your eyes or power off the screen and the words are gone. 

If you want to take steps to filter the speech you see and interact with personally, that's fine. That's your privilege. But as soon as you start discussing how the group can do something to limit how many people are exposed to certain speech or how to punish someone for some kind of speech, I'm not on board with that.