Unfortunately it's true... If you don't have a PFP set, some clients display an unique image based on your npub, so it's almost impossible to make a fake of your profile... It thought that people was removing the picture with that in mind.
 

 Thank you for the info