OK, but fungi have multiple sexes, what about them? You still need 2, always, but the sexes in fungi have lots to choose from. What's up with that?

(Not disagreeing with your assessment, just a thought that occurred to me.) 

 I don't know.  I think we would need a biologist who knows the answer.