problem is seed xor is just a way to split up the randomness you also need some way for the people that hold each piece to collaborate to sign a message without revealing their keys 

 Good point about not revealing. I assumed the OP controlled all servers.