hi,
i have a robots.txt file with this content:
User-agent:*
Allow: /
Allow: /sitemap
Disallow: /gerente

is it written in right order?

Recommended Answers

All 2 Replies

Hi,

I think these 2 lines would be not useful Allow: / Allow: /sitemap for any purpose since they are allowed by default. Also, might I suggest the contents on robotstxt.org/orig.html#examples for you to read.

all the best,

My robots.txt file looks like this:

Sitemap: http://www.daniweb.com/sitemap.xml

User-agent: Googlebot
Disallow: ...........

It sits in the root directory. I think that Allow is explicit.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.