I'd agree that arguing/pushing to achieve the ideal, when things are already bad and also trending towards the worse, is good. Will any ideal (regardless of which goal you choose) ever be achieved? No. And that's okay IMO. You won't ever have absolute freedom, no matter how hard you fight for it, unless you entirely leave society.
or if we rebuild society on better principles. middle ground implies that we should give up something. the only thing we should give up is the government.
I think we are already building parallel structures where we have more freedoms. In the digital realm it's possible and yes, the physical realm might be lost but that's more and more ok as long as "being big" in the physical realm isn't important to you. How important is living in a big mansion with five Ferraris to you?