It does matter, but... hmm...
These dunbar numbers thing has some sense on the topic...