# robots.txt for https://eprint.iacr.org/ # we also use other mechanisms to control crawling. # for questions about this, send email to Kevin McCurley User-agent: * Crawl-Delay: 9 User-agent: * Disallow: /cgi-bin/ Disallow: /eprint-bin/ Disallow: /eprint-test-bin/ Crawl-delay: 20 User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SputnikBot Disallow: / User-agent: BLEXBot Disallow: /