@ed709062 sorry but this is absolute nonsense. When someone is running a DDoS attack on you, you block or throttle them, this is Internet basics. Crawling the same page 500 times a day is an attack, even you have a threshold, maybe its not 500, maybe its 5 million, I don't know.