Pretty sure this is already done. Just login with your public key instead of your private one. 

Apps like Nostur also provide an anon gues account.