How Robots.txt is to be placed in the web site?
tomibaw
0
Newbie Poster
Recommended Answers
Jump to PostPlace the file in the root directory of your website. You can use the meta element for specific parameters with regard to user agents.
https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag
All 2 Replies
JorgeM
966
Problem Solver
Team Colleague
Featured Poster
Place the file in the root directory of your website. You can use the meta element for specific parameters with regard to user agents.
https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag
DarkMonarch
1
Newbie Poster
mine is here: ../var/html/www/robots.txt
Be a part of the DaniWeb community
We're a friendly, industry-focused community of 1.20 million developers, IT pros, digital marketers, and technology enthusiasts learning and sharing knowledge.