Silent Payment syncing on a full node, which you should have anyway, should add less than 1% overhead.

For light clients there isn't even a full spec yet on how to do that, so I'm not sure what mechanism you used. It should be comparable to bip158 sync.

In any case Silent Payments are just a way to avoid address reuse, they're not trying to achieve the same thing as Monero.