Seems to keep coming back to the idea of web of trust for me. For instance, my phone is permanently set to send anyone not in my contacts directly to voicemail. It's the only way I maintain sanity from the spam calls.  Would be interesting if I could set a "degrees of separation" to also allow people that know the people in my contacts, but that raises privacy implications too.