# Whitelisted user-agents are allowed User-agent: * Disallow: /customers/ Disallow: /secretsauce/ User-agent: googlebot Disallow: /cgi-bin Disallow: /erbmania/images Disallow: /includes Disallow: /tangor Disallow: /*? Disallow: *.gif$ Disallow: *.jpg$ User-agent: bingbot Disallow: /cgi-bin Disallow: /erbmania/images Disallow: /bay Disallow: /includes Disallow: /tangor Disallow: /*? Disallow: *.gif$ Disallow: *.jpg$ # Disallow all others User-agent: * Disallow: /