Fully understand. This is a huge solution for a camper.
After having our fridge on our battery i decided to cut it off the system cause it drains the battery in lightspeed.
so it is clear that i will have to find another fridge that is more efficient.
my aim is to use the fridge itself as a storage. Cause indeed it is. So I'll try to find the balance between panels and fridge. Obviously you need to have more power on the fridge when it is hot. But then the sun is shining more so you automatically have a balancing factor. If it is balanced perfectly i guess you'll not need a battery anymore for it. 
This is the main reason i seperated it.
I'll use our fridges at home the same way in future.
Fridge = Energystorage /latency