29291 2015-11-15 02:52:10 +0000 robots.txt on 1 site supposedly blocking some URLs in other sites 2015-11-15 02:52:10 +0000 1 1 1 Unclassified Validator check HEAD PC Linux NEW http://cold32.com P2 normal --- 1 Nick_Levinson dave.null dave.null www-validator-cvs www-validator-cvs oldest_to_newest 124210 0 Nick_Levinson 2015-11-15 02:52:10 +0000 The W3C Link Checker, when I entered <http://cold32.com>, allowed 10 levels of recursion (more than needed), and set it to send the Referer, didn't check a small percentage of links because it supposedly was blocked by <robots.txt>, but I saw no block in http://cold32.com/robots.txt and don't know why any other robots.txt file would control this: from <http://cold32.com/4/clothing-and-hair/2/where-to-buy-coats.htm>: http://www.gutenberg.org/cache/epub/7213/pg7213.txt from <http://cold32.com/5/action/6/showers-but-not-heaters.htm>: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2094925/ from probably most *.htm and *.html pages: http://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js For this bug report, I guessed the component and the version; the version is actually 4.81.