# robots.txt for http://www.incruit.com/ User-agent: * # directed to all spiders, not just Scooter Disallow: /bin Disallow: /data Disallow: /G_Common Disallow: /L_Common Disallow: /g_common Disallow: /l_common # Rover is a bad dog User-agent: Roverbot Disallow: / # HMSE_Robot is a bad dog User-agent: HMSE_Robot Disallow: /