# The Big Cartoon DataBase # Crawlers are welcome at a gentle pace. The server slows down any crawler that goes too fast. User-agent: * Disallow: /search # Person pages: the plain page is enough; please don't walk every tab and page number. Disallow: /person/*? Crawl-delay: 5 # Not permitted: Baidu, and marketing and link-analysis tools. User-agent: Baiduspider User-agent: SemrushBot User-agent: AhrefsBot User-agent: MJ12bot User-agent: DotBot User-agent: BLEXBot User-agent: DataForSeoBot User-agent: Bytespider User-agent: PetalBot User-agent: KeenableBot Disallow: / # A guide to BCDB for AI assistants: https://www.bcdb.com/llms.txt Sitemap: https://www.bcdb.com/sitemap.xml