The follows of follows is a very moderate number and even if it were a million, that's very much manageable. You throw them into a cockoo filter that's far less than 1MB and you can filter by that set trivially in RAM and CPU.