Under what circumstances would you look to exclude pages from search engines using robots.txt vs meta robots tag?
marinkapell1
0
Newbie Poster
Recommended Answers
Jump to PostPages you didn't want the search engine to index.
Okay, to be more specific, log-in pages to admin sections of a site.
Any other admin type pages, say for a CMS.
Members areas that might include a set of tutorials or pdfs or private info of some sort.
All 2 Replies
Reply to this topic
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.