If I want to disallow them all in robots.txt, are both of these valid and will they do the same thing?
Will the latter also block the URL www.daniweb.com/foo or will that be interpreted as a page underneath the root directory, and not within the foo directory? Contrastly, will the former be interpreted as only blocking the single page and not the foo directory?
5 Months Ago
Related Article:Running asp or asp.net on apache
is a Linux and Unix discussion thread by chunguy that has 6 replies, was last updated 1 year ago and has been tagged with the keywords: apache.