DaniWeb IT Discussion Community - Sitemap in robots.txt

DaniWeb IT Discussion Community (http://www.daniweb.com/forums/index.php)

- Search Engine Optimization (http://www.daniweb.com/forums/forum45.html)

- - Sitemap in robots.txt (http://www.daniweb.com/forums/thread75516.html)

cscgal

Apr 16th, 2007 3:33 pm

Sitemap in robots.txt

I thought you were supposed to put a link to your sitemap in your robots.txt (isn't that what you said, stymiee?)

My robots.txt now looks like the following:

Sitemap: http://www.daniweb.com/sitemap.xml

User-agent: *

Disallow:

Google Webmaster Tools robots.txt says "Syntax not understood" for the sitemap line.

stymiee

Apr 16th, 2007 5:17 pm

Re: Sitemap in robots.txt

You can. Google announced it in their blog. Looks like they haven't updated their webmaster tools to reflect that. I wonder where can inform them of it?

Candy_ME

Apr 18th, 2007 8:24 am

Re: Sitemap in robots.txt

Oh!!! This information is really helpful. Does Yahoo have a nofollow facility?

stymiee

Apr 18th, 2007 8:46 am

Re: Sitemap in robots.txt

They say they do but many people also claim they haven't implemented it yet.

All times are GMT -4. The time now is 5:45 am.