It does matter, but... hmm... These dunbar numbers thing has some sense on the topic...
Since only about 2% of npubs engage, and the rest lurk or are bots, you're ability to interact well would max out at circa 7500 npubs. Seems accurate.