User-agent: * Crawl-delay: 2 Request-rate: 1/5 # maximum rate is one page every 5 seconds Visit-time: 0200-1500 # only visit between 6:00 PM and 9:00 AM UT (GMT) Disallow: /cgi-bin/ Disallow: /images/ Disallow: /tmp/ Disallow: /temp/ Disallow: /private/