# # nobots.txt for http://www.w3.org/ # # this file is served as robots.txt when the HTTP Host is not www.w3.org, # to prevent specific www mirror hostnames from being crawled/indexed. # # $Id: nobots.txt,v 1.1 2009/10/27 23:53:01 gerald Exp $ # User-agent: * Disallow: /