I'm using a list of "spam-safe" relays but apparently I am missing a lot of replies from people whose clients are sending their replies to my inbox relays.

When browsing other people's notes, though, this technique doesn't work well or needs more thought because people replying to others are not going to send their replies to my own inbox list of relays.