I wouldn't do this unless you have a very good labeling system. Maybe use a BIP85 wallet for one or the other, derived from the 'main' wallet you want to move to, to keep the segregation.