Fermentation is pretty hard on delicate flavors. It might stay or could be added back. Maybe soak some oak chips in vanilla then add the vanilla?