Is there a specification for private follow lists, or another solution towards the same goal? 

 Yes, it's simply an encrypted blob that contains the followers.