If you're using Alby, and you've recovered yourr account, it initially generates a new nsec for your to use--you need to go into Alby and put in (manually) the nsec you'd like to use and you'll be logged into the account you're expecting. 

 Ahhh this must be why!! 

 The settings are within the dropdown when you click on your email account...