Basically, almost nothing is stored on your client. When anyone, including you, wants to get your follow list it is queried from the relays. Clients sometimes cache information so they don’t have to request the same notes or images constantly, but the vast majority of information is still stored on relays.