Amen Brother, I've run into this a lot in the sailing world(mostly olds).  If you try to step out of the traditional norms people just want to shit on you.  

People hate the idea that someone else can do something they can't.  

But so far I've managed to prove them all wrong, the bar is pretty low imo.  Just dream big and work your ass off.