It will only work at scale if people are tricked by it and they make money. I don’t think this will be a huge problem, because inevitably it will take an enormous amount of computation. Think of it like a huge computational proof of work to fake and environment around someone. It will more likely be something that’s either casting a huge net for the lowest common denominator of doofus (think Nigerian princes), or that will target with precision a specific person or small group to infiltrate or influence.

I will expect this to be a political maneuver more than anything and it will last as long as politics has outsized control over society (which I also think will diminish thanks to the proliferation of these same tools)