User-agent: ia_archiver Disallow: /css/ Disallow: /js/ Disallow: /img/ Disallow: /files/ User-agent: W3C-checklink User-agent: Xenu's Disallow: User-agent: searchpreview User-agent: girafa Disallow: /js/ Disallow: /files/ User-agent: Googlebot-Image User-agent: psbot User-agent: msnbot-media User-agent: VoilaBot Disallow: /img/ Disallow: /files/ User-agent: msnbot User-agent: Slurp User-agent: Teoma Crawl-delay: 86400 Disallow: /css/ Disallow: /js/ Disallow: /img/ Disallow: /files/ User-agent: Seznambot User-agent: Jyxobot User-agent: holmes Disallow: /img/ Disallow: /files/ User-agent: * Disallow: /img/ Disallow: /files/