It will only work at scale if people are tricked by it and they make money. I don’t think this will be a huge problem, because inevitably it will take an enormous amount of computation. Think of it like a huge computational proof of work to fake and environment around someone. It will more likely be something that’s either casting a huge net for the lowest common denominator of doofus (think Nigerian princes), or that will target with precision a specific person or small group to infiltrate or influence.
I will expect this to be a political maneuver more than anything and it will last as long as politics has outsized control over society (which I also think will diminish thanks to the proliferation of these same tools)
Some of the people can be fooled all the time.
All of the people can be fooled some of the time.
But not all of the people can be fooled all of the time.