For every font that gets it right there are ten thousand that get it wrong. Just look at the garbage on publicly available free font and pirate sites. Training machine learning on this is going to go nowhere: garbage in, garbage out. The only entity I can envision being able to do successful machine learning would be Monopolytype.

And pirates. 

 @3e992358 good luck to them.