Humans are not natural carnivores. The issue is that everyone has individual sensitivities to specific foods. The carnivore diet cuts all those things out, which is why most people see such large benefits. 

It would be best to cut down to meat only, and slowly reintroduce individual foods and pay attention to how your body reacts.