943,536 Members | Top Members by Rank

Ad:
Mar 27th, 2007
0

Robots Result

Expand Post »
Hi,

I have a quick question! I have implemeted robots.txt to disallow some of my pages! How long it will take to do this? whether i can get all my pages OUT OF INDEX all at a time or it will happen pages by pages. I'm confused

Ideas are welcome
Similar Threads
Reputation Points: 10
Solved Threads: 0
Newbie Poster
harininet is offline Offline
23 posts
since Aug 2006
Mar 27th, 2007
0

Re: Robots Result

It depends on your site. Sites that are crawled more frequently will see results faster then sites crawled less frequently. If you want pages removed from the SERPs quickly robots.txt is not your best option. Use a removal request instead.
Moderator
Reputation Points: 161
Solved Threads: 38
He's No Good To Me Dead
stymiee is offline Offline
1,422 posts
since May 2006
Mar 28th, 2007
0

Re: Robots Result

when the seach engine crawls your site the first file it hits is robots.txt and if it sees to disallow any files it won't index them which means they should go off there index!
Reputation Points: 10
Solved Threads: 4
Light Poster
nytrokiss is offline Offline
47 posts
since Jun 2006
Mar 31st, 2007
0

Re: Robots Result

when the bot crawls thats the time when it'll see what is allowed and whats not allowed and make sure u use opening slash / and closing slash /

/images/

something like that when not allowing the bot to crawl with the right syntax =)
Reputation Points: 11
Solved Threads: 0
Junior Poster in Training
webmasterran is offline Offline
72 posts
since May 2006
Apr 5th, 2007
0

Re: Robots Result

Yes, I agree with webmasterran. I too use robot,txt for my sites to say the search engines not to crawl my page.
Reputation Points: 10
Solved Threads: 0
Junior Poster in Training
Candy_ME is offline Offline
65 posts
since Mar 2007

This thread is more than three months old

No one has posted to this discussion for at least three months. Please let old threads die and do not reply to them unless you feel you have something new and valuable to contribute that absolutely must be added to make the discussion complete. Otherwise, please start a new thread in this forum instead.
Message:
Previous Thread in Search Engine Optimization Forum Timeline: Matt Cutts Hacked! Yes or No?
Next Thread in Search Engine Optimization Forum Timeline: Supplemental and old 404 pages( google automated removal tool)





About Us | Contact Us | Advertise | Acceptable Use Policy
Forum Index | Build Custom RSS Feed


Follow us on Twitter


© 2011 DaniWeb® LLC