What if you store the passphrase (but not the seed phrase) in a password manager?
this always made the most sense to me because I see the passphrase as a physical 2-factor. People might feel the need to store two seeds physically nearby which would be a mistake.
IMO the passphrase probably doesn't even need to be that complicated either and could be something that's super easy to memorize. So you'd have to forget it and lose access to your password manager.