# Brendan Robson # 15/01/06 # # Action: Prevent all web robots from all files # Avoid 'missing file' errors building up in web logs # # Notes: 1. See notes in file= # Log 7=Website error log+Robots.doc # 2. Edit this file in PFE & 'save as' with 'unix format' ticked # 3. Upload this file to: # /home/8477/jennifer1/www.celtic-art.ltd.uk/public_html #______________________________________________________________________ # To keep all robots out: # User-agent: * # Disallow: / # Allow only 'public_html\acatalog' # I'm not sure if these next lines are required since they are below public_html User-agent: * Disallow: /cgi-bin/ Disallow: /logs/