Essentially, your follow list gets saved to certain relays by one client. You go to another client and add or remove a follow and instead of taking your existing list into consideration, it creates a new list, nuking your existing one because relays only keep the most recent version of your follows.

This is why backing it up on the regular using Citrine or other tools is a good idea.