Thread: Using a robots.txt to block links
View Single Post
•
•
Join Date: Jun 2004
Posts: 118
Reputation: Arizona Web is an unknown quantity at this point 
Solved Threads: 2
Arizona Web's Avatar
Arizona Web Arizona Web is offline Offline
Junior Poster

Re: Using a robots.txt to block links

 
0
  #8
Jun 14th, 2004
•
•
•
•
Originally Posted by cscgal
It would be very nice if the robots.txt would block the weakening spread of PR. However, even if it doesn't do this, it would still be valuable because it would eliminate spidering duplicate content (i.e. showthread.php?t=10 and thread10.html)
*nods* for sure.
Need a website designer? arizona web design : phoenix web design : MCP Media intelligent web design and web development solutions. MCP Media is owned and operated by Chris Hooley - who happens to be a real nerd... on purpose :-)
Reply With Quote