How Robots.txt is to be placed in the web site?
tomibaw
0
Newbie Poster
Recommended Answers
Jump to PostPlace the file in the root directory of your website. You can use the meta element for specific parameters with regard to user agents.
https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag
All 2 Replies
JorgeM
958
Problem Solver
Team Colleague
Featured Poster
Place the file in the root directory of your website. You can use the meta element for specific parameters with regard to user agents.
https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag
DarkMonarch
1
Newbie Poster
mine is here: ../var/html/www/robots.txt
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.