It's an open protocol, to control who uses it you need to control the relay. Otherwise you're asking client creators to allow censorship, which is what they are trying to avoid. A private relay is you're own business though.  

 Well it's weird you're calling it cencorship.
It's like when I use signal to DM someone will be called cencorship.