After removing from the fridge, I always add more flour and some cane sugar and honey, which definitely gets consumed and turned into loft. 
I’m probably freaking out over nothing and should make the bread. I just remember it failing the last time though it had worked before.