I actually think the biggest problem is that people will suspect it's fake, but never be able to look at you again, without thinking about it.
It's a form of slander.