How Robots.txt is to be placed in the web site?
tomibaw
0
Newbie Poster
Recommended Answers
Jump to PostPlace the file in the root directory of your website. You can use the meta element for specific parameters with regard to user agents.
https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag
All 2 Replies
Be a part of the DaniWeb community
We're a friendly, industry-focused community of 1.20 million developers, IT pros, digital marketers, and technology enthusiasts learning and sharing knowledge.