Which one is better Robots.txt or Meta robots Tag ?
Jump to Post
It depends what you're trying to do. We use
<meta name="robots" content="noindex" />when we want Google to crawl a page (and follow outgoing links on it), but not index the page itself (because it's thin content, for example). We use robots.txt to block pages from Google that are unavailable …
All 6 Replies
Be a part of the DaniWeb community
We're a friendly, industry-focused community of 1.20 million developers, IT pros, digital marketers, and technology enthusiasts learning and sharing knowledge.