Robots.txt - Networking | DaniWeb

Hardware and Software

Programming

Digital Media

Community Center

Start New Discussion within our Networking Community Not Yet Answered

Donate $1 now to see this question answered quickly

Sponsored questions offer a monetary incentive to answerers to produce quality responses.

Be intelligently matched with 5 likely answerers who will be alerted to help.

3

Contributors

2

Replies

5

Views

3 Years

Discussion Span

Last Post by DarkMonarch

0

How Robots.txt is to be placed in the web site?

1

Place the file in the root directory of your website. You can use the meta element for specific parameters with regard to user agents.

https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag

0

mine is here: ../var/html/www/robots.txt

This article has been dead for over six months. Start a new discussion instead.