Don't worry there are men who struggle with this too. Faces tend to be hard to draw in general.