My amateur opinion is that it's the zipper pull rubbing and catching on the fibers. Maybe try a coat of clear nail polish to smooth out any rough spots on it?