I have the same opinion, voicing it for some time now.

I believe that IPFS is a decent solution, and if any issues with IPFS, working to solve it would make tons of sense. This will make the client side 100% decentralized. Currently, all web based are centralized and therefore subject to closure.

For the relays, IPFS won't do, but an easy solution will be a pruned relay for Umbrel. 

While building any NOSTR or Bitcoin related application, security, privacy and decentralization should be the prime directive above all in the design phase, yet, most applications fail miserably