If one speaks to some famous personalities, the loss of anonymity is the greatest loss, and irreplaceable, to them.  I remember being a relative geeky nobody, and then married a very popular, cool guy, moved to his town and… instant microscope. The trade off is real.