I agree we have to get to know our neighbors.  That's crucial.

The way to break the fear culture may be to create bubbles of a counter-culture.  Maybe we should make a point to move so as to be near like-minded families.  If there is no consensus favoring unsupervised play, we have to build one, and let it spill naturally out into our communities.