# This is the standard "robots.txt" file for giving instructions to web bots. # This is mostly to tell robots not to scan jc's tmp and log directories: The # people and pn directories were relics that shouldn't exist any more; they # are listed here so that if they get reconstituted, they won't be scanned. # The "honey/pot" directory is here to identify robots that follow links that # are disallowed. User-agent: * Disallow: /~jc/cgi/ Disallow: /~jc/music/bot/ Disallow: /~jc/tmp/ Disallow: /~jc/people/ Disallow: /~jc/pn/ Disallow: /~jc/wrk/ Disallow: /~jc/ndx/ Disallow: /~jc/ntl/ Disallow: /~jc/msg/ Disallow: /~jc/demo/msg/ Disallow: /~jc/honey/pot/