I wouldn't fear, the government is stoking fear and panic in order to pass draconian legislation.
The percieved conflict is much more asymmetrical in reality: the response to this unrest from the state, antifa, the ngo complex and the immigrant community itself dwarfs the "far right" or whatever you want to call them by an overwhelming margin, most of it organised with lightning fast speed and precision, suggesting it isnt entirely grassroots.
I just seen a video today of a man (I presume he was muslim) ,surrounded by ngos and antifa types, calling for protestors throats to be slit and he was met with applause, meanwhile this highly dangerous racist mob if we are to believe it, can't even share videos or communicate online without being surveilled and arrested.
I'm not saying this to take sides, merely to answer your question about how immenient a threat this is to you in reality, I believe it's blown wildly out of proportion in order to manufacture public consent for facial recognition data collection, draconian regulation of online communication, introduction of the notion of 'pre-crime' and censorship in general.