# robots.txt is a good robot User-agent: * Disallow: /sub_site/ Disallow: /it_security/sub/