My advice is to not insulate unless you're housing delicate breeds. Most chicken breeds have no problem in those temperatures as long as they are dry and protected from drafts.

Insulation is pretty much meaningless if you have ventilation and if you do not have ventilation there will be humidity which will increase likelihood of frostbite.

The key to happy healthy chickens in the winter is ventilation but no drafts directly on the roost.