Oddbean new post about | logout
 Add OpenAI, Google, and Common Crawl to your robots.txt to block generative AI from stealing content and profiting from it. See https://www.cyberciti.biz/web-developer/block-openai-bard-bing-ai-crawler-bots-using-robots-txt-file/ for more info and firewall to block those and other AI bots too.

https://files.mastodon.social/media_attachments/files/111/150/376/103/641/549/original/ddfa3856f9b4263d.png