One thing I remember hearing somebody point out is that the second you accept anything other than plain text you take on a whole new set of responsibilities & risks.

Not that I'm in any way knowledgeable enough to advise development, but I personally like the idea of relays being text only by default. Keeps things lightweight, and sure there can be bad things with text but the real bad stuff always needs to stay off Nostr infrastructure.