Given how fast pubky is, it shouldnt be a big deal.  It's all PKI.  The only challenge is when keys change and rotate.  But that's a whole other problem.  What we gain today is huge already.