There would be a hell of a empty unusable spaces in that house. But still a nice idea I guess. 

 You can always put some plants, make a jungle house