Well, easy enough to avoid unwittingly being "the other man", nowadays.

Also, if the "other man" has children with her, too, or is incapable of siring children, he may decide it's worth the effort. Being a stepfather isn't necessarily a bad deal. 

 I am a stepfather and a father and a grandfather and a grand stepfather and I play with babies whenever I can even if they're not my blood relatives