It’s not possible to be totally independent because man, by nature, depends on others. We know this innately when we’re around newborn babies. The most important aspects of our lives are relations to others (spouse, friends, etc.) There’s also the problem that “being left alone” doesn’t stop others from getting together and doing evil not just amongst themselves but eventually to others. Libertarianism doesn’t work.
We have a responsibility to ourselves, each other, and God to strive towards the common good as a society.