That's not true. If you think analytically, you should be able to distinguish properties, characteristics, etc that are relevant, then base your judgement on those. Any shortcuts you take that involve the "human" are variations of deferring thinking to said human and relying on (possibly unwarranted or unjustified) trust. That isn't necessary at all.
And, actually is a weird choice in itself given the miriad of vulnerabilities that are rooted in good intentions gone bad as opposed to "evident bad actoe" doing evil.