How Robots.txt is to be placed in the web site?

Recommended Answers

Place the file in the root directory of your website. You can use the meta element for specific parameters with regard to user agents.

https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag

Jump to Post

All 2 Replies

mine is here: ../var/html/www/robots.txt

Be a part of the DaniWeb community

We're a friendly, industry-focused community of 1.20 million developers, IT pros, digital marketers, and technology enthusiasts learning and sharing knowledge.