This is an archived snapshot of W3C's public bugzilla bug tracker, decommissioned in April 2019. Please see the home page for more details.

Bug 12386 - missing 2 new entries, robot.text is ignored
Summary: missing 2 new entries, robot.text is ignored
Status: RESOLVED WORKSFORME
Alias: None
Product: LinkChecker
Classification: Unclassified
Component: checklink (show other bugs)
Version: 4.5
Hardware: PC Windows XP
: P2 critical
Target Milestone: ---
Assignee: Ville Skyttä
QA Contact: qa-dev tracking
URL: http://www.amelox.com
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-03-28 00:27 UTC by Ralph Seabrook
Modified: 2011-03-30 19:42 UTC (History)
0 users

See Also:

Attachments
as described in the text (955 bytes, text/plain)
2011-03-28 00:27 UTC, Ralph Seabrook 		Details

Description Ralph Seabrook 2011-03-28 00:27:13 UTC 
Created attachment 971 [details]
as described in the text

I use the online version of checklink

Hi guys,
A week ago I added 2 new Web pages.  They do not show up in Linkchecker.
Their headers have  "index, follow" />.
I checked robot.text -- cannot find any fault.
Added the two files as special ALLOWED: .....    makes no difference.
I then disabled the robot.txt file
guess what:  Linkchecker says the old robot.txt is still there!

the robot.txt file was changed to "robot.txt.old" to make it invisible.

Thanks for your help.
Rolf
Comment 1 Ville Skyttä 2011-03-28 17:47:15 UTC 
What is the URL of the page that contains the links?  What are the links to the 2 new web pages in it?

Note that the file name for robots.txt should be robots.txt, not robot.text nor robot.txt.
Comment 2 Ville Skyttä 2011-03-30 19:42:26 UTC 
Submitter notified in private mail that the problems have been solved.