What would be the difference if you use a robots.txt file or the Robot MataTag <META name="robots" Content="Index,Follow">
Can you use both?
extofer
-2
Posting Whiz in Training
Recommended Answers
Jump to PostYou can buit it is pointless. Robots will index and follow the links on every page by default. This makes that tag redundant and useless. Only use it to block robots.
All 2 Replies
stymiee
111
He's No Good To Me Dead
Team Colleague
You can buit it is pointless. Robots will index and follow the links on every page by default. This makes that tag redundant and useless. Only use it to block robots.
newonlineinfo
0
Junior Poster in Training
What would be the difference if you use a robots.txt file or the Robot MataTag <META name="robots" Content="Index,Follow">
Can you use both?
Hi,
One simple answer,
Meta tag is to direct/block each and ever page
Robots text file is to block the entire folder
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.