The security filter setting - filter spam from strangers - spammers - in Amethyst seems to be automatically adding random people to the list. I disabled that checkmark. 
Automatically deciding for me is not a good solution. It blocked some good profiles. 

I am using GitHub amethyst on a de-googled phone. lineageOS.