Yes but the trade-off is that it then becomes even harder for folks to be discovered on Nostr. 

Replying to people & zapping is a way for a new user to be discovered & build some trust. 

Using a WoT to filter replies builds in a kind of invitation system to your social network.

I'm not saying that it's not the best approach but that there are tradeoffs. This is especially true if most clients implement this functionality.