But what if someone didn’t want to help build the wall? Same thing applies, are they forced to help, or forced to leave? 

When you live with your group of people who don’t believe in coercion, how would you coordinate with them to build a wall to protect yourselves?