| | |
Robots Result
Please support our Search Engine Optimization advertiser: Get a Free SEO Analysis!
![]() |
It depends on your site. Sites that are crawled more frequently will see results faster then sites crawled less frequently. If you want pages removed from the SERPs quickly robots.txt is not your best option. Use a removal request instead.
John Conde
Brainyminds | Merchant Account Services | I Love Code
IT'S HERE: Merchant Accounts 101 Everything you need to know about merchant accounts!
Brainyminds | Merchant Account Services | I Love Code
IT'S HERE: Merchant Accounts 101 Everything you need to know about merchant accounts!
•
•
Join Date: Jun 2006
Posts: 47
Reputation:
Solved Threads: 4
when the seach engine crawls your site the first file it hits is robots.txt and if it sees to disallow any files it won't index them which means they should go off there index!
when the bot crawls thats the time when it'll see what is allowed and whats not allowed and make sure u use opening slash / and closing slash /
/images/
something like that when not allowing the bot to crawl with the right syntax =)
/images/
something like that when not allowing the bot to crawl with the right syntax =)
•
•
Join Date: Mar 2007
Posts: 65
Reputation:
Solved Threads: 0
Yes, I agree with webmasterran. I too use robot,txt for my sites to say the search engines not to crawl my page.
![]() |
Similar Threads
- Game: Robots (Class, Constructors, etc.) (C++)
- Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource (PHP)
- Using a robots.txt to block links (Search Engine Optimization)
Other Threads in the Search Engine Optimization Forum
- Previous Thread: Matt Cutts Hacked! Yes or No?
- Next Thread: Supplemental and old 404 pages( google automated removal tool)
| Thread Tools | Search this Thread |
Tag cloud for Search Engine Optimization
advertising affordable airplane alm analytics apple audioanalytics audiosearch benefits bing block blog blogs business design development digital directory dynamicdigitalsignage ecosia engine enterprisesearch facebook failure feeds firefox flashwebsiteoptimizationtips gaudi gmail google googleanalytics googlelongersearchbox googlesearch hitwise hub imagerecognition imagesearch india internet internetmarketingcompanyindia keyword keywords kumar leweb link list lsi marketing microsoft money news nexidia no-follow obama opencalais optimizingforbing pagerank pages plug-ins posts privacy ranking revenue search searchengine searchengineoptimization semanticsearch semanticweb seo seocompany seooptimizationindia seoservices services sets sex sitesearch socialnetworking space spam stalking storage sullivan system testing twitter video videosearch viralmarketing wave web webdesignindia webmarketingcompanyindia webmaster website wolfram wolframalpha wordpress yahoo yahoo! youtube






