How do you protect against your yubi key breaking or getting lost. It is a single point of failure and has always worried me about using gpg in this way. 

 You can load a GPG key into multiple yubikeys.

Any decent service should allow you to add multiple 2FA yubikeys.