Are you using other clients? They are probably erasing your lists when you follow/unfollow people. If exported and imported then it would erase the follow/unfollow you just did.