I clicked followed in the sidebar, then top right "edit list" button, and then merge, and that brought in all the missing people