This is an archived snapshot of W3C's public bugzilla bug tracker, decommissioned in April 2019. Please see the home page for more details.
Created attachment 971 [details] as described in the text I use the online version of checklink Hi guys, A week ago I added 2 new Web pages. They do not show up in Linkchecker. Their headers have "index, follow" />. I checked robot.text -- cannot find any fault. Added the two files as special ALLOWED: ..... makes no difference. I then disabled the robot.txt file guess what: Linkchecker says the old robot.txt is still there! the robot.txt file was changed to "robot.txt.old" to make it invisible. Thanks for your help. Rolf
What is the URL of the page that contains the links? What are the links to the 2 new web pages in it? Note that the file name for robots.txt should be robots.txt, not robot.text nor robot.txt.
Submitter notified in private mail that the problems have been solved.