I'm less black and white about it now. @ferret reminded me of a potential accidental image self dox. Thankfully I was able to get it removed from imgur for that.
Even if it is difficult, if not impossible to guarantee deletion across multiple relays - I'm okay with that illusion of deleting egregious typos and attempting to replace with a better version.
Also, I've heard a rumor that lots of dm's can slow/crash a client (Amethyst in particular), so deleting to remove them is also something I'm okay with just to improve client stability. This is definitely a practice I engage with because I occasionally self DM to check if my note renders correctly.
Again though, for me its not so black and white and I understand both sides.