That's not what happened. They were "removed" from my list. I had to click, follow, again.
Ohh what app(s) are you using? This is a bug a bunch of us are trying to track down and resolve. Also what relays did you remove? You can send this info via DM if you prefer. Thanks!