They can just terrify the locals and take their houses, when they move away. That's the usual path.