it's probably because you're responding to it.

I just say "no I don't accept Monero" and they go crazy with zero understanding of my brand on top of just me not wanting Monero  

 It is OK to accept fedcoins.

Most people don't care about privacy.