User-agent: * Disallow: /cgi-bin/ Disallow: /edeliver/ Disallow: /edeliver-internal/ Disallow: /site-dav/ Disallow: /passwd/ Request-rate: 1/5 # one page every five seconds Visit-time: 0900-1500 # Only visit between 0200h and 0800h PST