@ab7cf35b @02ecde16 

imho: Scientific models are a bit different than ML models -- they are closer to generator programs than to classifiers or function approximators. 

If theories are closer to programs, they are better defined by Kolmogorov complexity;  classifiers and function approximators are better defined (as mentioned) by VC dimension or Rademacher complexity... 

Theories also call each other recursively, like Maxwell's equations; another reason to consider them 'programs'.