User-agent: * # Verzeichnisse teilweise ausklammern Disallow: /pics/ Disallow: /public/test/images/ Disallow: /public/images/ Disallow: /amarok/ Disallow: /files/ # Siteloader ausklammern User-agent: Teleport* Disallow: / User-agent: Webwhacker Disallow: / User-agent: WebDevil Disallow: / User-agent: Webzip Disallow: / User-agent: Net Attache Disallow: / User-agent: SiteSnagger Disallow: / # eMailscanner ausklammern User-agent: WX_mail/2.000 Disallow: / User-agent: EmailCollector Disallow: / User-agent: WhoWhere Disallow: / User-Agent: Roverbot Disallow: / User-Agent: ActiveAgent Disallow: / User-agent: EmailSiphon Disallow: /