I've heard much worse. Honestly fraud and tax evasion makes him look more legit.

The real dark possibility is that he's a front for the CIA and is able to take on so much risk because he knows they have his back. 

Which I don't believe by the way, but if you're going to FUD Saylor at least make the FUD good.