They should be fine without heat unless you are in Alaska... but yes stopping drafts is a good idea. You don't want snow blowing in there...
This is my first winter with chickens. I had quail for the last 2 years and it was very important with the quail to keep dry and out of the wind.