Or, ignore those who talk shit?
You can be more or less resilient, but no one is immune to it. Also, other less informed people get taken in by the trash talkers.