No, they're supposed to stay in there because you need to either soder or hammer em with the right pins.

https://github.com/shishi21m/SeedSigner-Guides/blob/main/SeedSigner%20Build%20Guide.pdf