It was deleting tags from the filter and making it so we would query external relays without the "d" tag and return anything from that pubkey instead of the correct event.