Speaking as a male, I just listened to a fiction audiobook today actually by a female author with female main characters. It makes no difference to me personally, though I do tend to find myself listening to a fair bit of female authors and books that I might not typically have chosen. But perhaps that's because I get them from podcast recs and then from the library, and then speed up everything, which grossly affects my reading, so even books I'm not that into, or that haven't been written 'for me' as the audience, I still speed through in a day. Interesting question.