This would be part of the benefit of multisig. A single set of seed words don't threaten your bitcoin and so you can still move them if a key has gotten compromised.
Seeds plus passphrase is a good poor mans multisig. Keep the seed and passphrase separate.