@ed709062 sorry but this is absolute nonsense. When someone is running a DDoS attack on you, you block or throttle them, this is Internet basics. Crawling the same page 500 times a day is an attack, even you have a threshold, maybe its not 500, maybe its 5 million, I don't know.
@4958ec32 Sure, if I'm running on-prem, for things that are easily cached like crawlers, I might start worrying about at around 10k-100k QPS if I wasn't caching and much more if I was caching and you apparently worry about it in the single digit QPS range. How do you reconcile this with your co-founder's opinion that engineers who can only doing 75% of the performance of an all-time-great team are "brutally bad", "terrible at their jobs", and deserve to lose their jobs?