Yeah you'd need other factors of authentication such as a secret or cryptographic signature.