I totally agree, I use signal for daily driver with the people I trust, I use simplex/threema for others. 

Yet phone numbers are still the best web of trust that exists.