User-agent: * Disallow: /amberdell-www/Archive/ Disallow: /amberdell-www/Art/ Disallow: /amberdell-www/admin/ Disallow: /amberdell-www/amber/ Disallow: /amberdell-www/cgi-bin/ Disallow: /amberdell-www/linda/ Disallow: /amberdell-www/s-cart/ Disallow: /amberdell-www/servlets/ Disallow: /amberdell-www/stats/ Disallow: /amberdell-anonftp/ Disallow: /amberdell-logs/ Disallow: /amberdell-mail/ Disallow: /amberdell-secure/ Disallow: /amberdell-webmail/ Disallow: /amberdell-www/home/ Disallow: /amberdell-www/catalpa/ # User-agent: Googlebot User-agent: InfoNaviRobot User-agent: TV33_Mercator User-agent: AVSearch User-agent: Mercator User-agent: Scooter User-agent: Slurp User-agent: SearchengineLicenceSheep User-agent: shadow User-agent: MultiText User-agent: FAST-WebCrawler User-agent: Lycos_Spider User-agent: Atomz User-agent: htdig User-agent: spider00.logika.net User-agent: NetMechanic User-agent: libwww-perl User-agent: Teleport Pro # created 2008-09-08 (edited )