User-agent: * Disallow: cgi-bin Disallow: /cgi-bin/ Disallow: images Disallow: /images/ Disallow: /usr/local/etc/httpd/htdocs/images Disallow: mp3 Disallow: /mp3/ User-agent: ia_archiver Disallow: /