The problem is that everything is wide open (for real, on protocol's end) in nostr. You couldn't really adjust that.

Still, Don't fediverse could do the same exact thing? Being half open or similar? Because other users from external server still could give a follow.