Either the loaner or the lender has the private key. Even in a multisig setup, 1 party has a chorum.
A legal contract does not enforce custody and has privacy implications in case of litigation.