Yeah that's a fair point.  Allowing implies privilege as opposed to inherent right.  Maybe a better way of putting it would be that we should agree as a society that property owners should be the ones to vote on property taxes.