Constant is right, without a reply/reaction by a followed user to a user you are not following, you don't have any clue about his existence in a thread.
You have to query some random "big" relays to find these missing users. The Outbox model does not prohibit this; it is a matter of tradeoffs, options and frequencies.