Robots.txt - Networking | DaniWeb

0

How Robots.txt is to be placed in the web site?

3

Contributors

2

Replies

5

Views

4 Years

Discussion Span

Last Post by DarkMonarch

1

Place the file in the root directory of your website. You can use the meta element for specific parameters with regard to user agents.

https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag

0

mine is here: ../var/html/www/robots.txt

This topic has been dead for over six months. Start a new discussion instead.

So you've lost access to your data through hardware failure or accidental erasure. What do you do? Like most cyber-warriors you naturally turn to the Internet, be that via a ...

This isn't a typical hardware post, but I couldn't find anywhere better for it.

Last October, after my previous TV packed in, I bought a shiny new Samsung Smart TV. ...

My wife and I live in an area where Satellite Internet and Phone are the only option unfortunately. So our complex setup involves a modem, router and telephone adapter. My ...