First I never said others are stealing so it’s okay for me to steal. Don’t misquote me.

Second, your statement about using government defensively is an oxymoron. The existence of government IS an infringement on natural rights. 

 You implied it.

You have a point that the very existence of government is an infringement. Unfortunately, it's not practical to ignore it completely. E.g. not use any roads.