isn’t the gossip/outbox model only useful for finding a persons notes when you want to look at their profile specifically?
that and when you are following them, the client knows where to look for a persons notes
also if you were to quote a note that's not in my relay list, there should be relay hints that tell my client where to look for said note