Our next home has a big oil tank, a wood-burning stove with a cooktop, and passive solar (hot water), but it's harder to heat in the winter, so our costs will stay about the same.
If you have a wood burner you can get a heater jacket for when the solar isn't heating that water enough. As for heating yourself, the trick is exactly that, heat yourself not the building.