Re: What is Robots in SEO ? 80 80

The robots. txt file, also known as the robots exclusion protocol or standard, is a text file that tells web robots (most often search engines) which pages on your site to crawl. It also tells web robots which pages not to crawl.

bestocbestoccup commented: Organized around a completely working nearby office with wellbeing as a primary goal, Equine treatment at Resolution Ranch was explicitly intended to +0
Re: What is Robots in SEO ? 80 80

Being a SEO executive, you should be aware of this simple and important thing.
Robots is generally a .txt files that indicate whether certain user agents (web-crawling software) can or cannot crawl pages of a website.

If you want to learn more, you can search internet for more detailed information.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of 1.19 million developers, IT pros, digital marketers, and technology enthusiasts learning and sharing knowledge.