I spent yesterday replacing all my regex output parsing with forced Json output Basically a probability mask to force tokens to json Sometimes model would screw me by ignoring my <parsing>tags</parsing>