Nope, the worst that would happen would be your pubkey would be shared with me. Not ideal, but also not sensitive.