| | |
Robots Result
Please support our Search Engine Optimization advertiser: Get a Free SEO Analysis!
![]() |
It depends on your site. Sites that are crawled more frequently will see results faster then sites crawled less frequently. If you want pages removed from the SERPs quickly robots.txt is not your best option. Use a removal request instead.
John Conde
Brainyminds | Merchant Account Services | I Love Code
IT'S HERE: Merchant Accounts 101 Everything you need to know about merchant accounts!
Brainyminds | Merchant Account Services | I Love Code
IT'S HERE: Merchant Accounts 101 Everything you need to know about merchant accounts!
•
•
Join Date: Jun 2006
Posts: 47
Reputation:
Solved Threads: 4
when the seach engine crawls your site the first file it hits is robots.txt and if it sees to disallow any files it won't index them which means they should go off there index!
when the bot crawls thats the time when it'll see what is allowed and whats not allowed and make sure u use opening slash / and closing slash /
/images/
something like that when not allowing the bot to crawl with the right syntax =)
/images/
something like that when not allowing the bot to crawl with the right syntax =)
•
•
Join Date: Mar 2007
Posts: 65
Reputation:
Solved Threads: 0
Yes, I agree with webmasterran. I too use robot,txt for my sites to say the search engines not to crawl my page.
![]() |
Similar Threads
- Game: Robots (Class, Constructors, etc.) (C++)
- Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource (PHP)
- Using a robots.txt to block links (Search Engine Optimization)
Other Threads in the Search Engine Optimization Forum
- Previous Thread: Matt Cutts Hacked! Yes or No?
- Next Thread: Supplemental and old 404 pages( google automated removal tool)
Views: 1354 | Replies: 4
| Thread Tools | Search this Thread |
Tag cloud for Search Engine Optimization
activateseo? advertising analytics apple archive articles backlinks bing blog blogs bomb building business cashback cheap chrome climate commenting company consumer corporateidentity customizations danny design development directory ecosia email engine engines england enterprisesearch estate facebook google googlebot googlesitesearch hacking india jcpenney jobsearch keyword keywords lens link linkbuilding links marketing men microsoft monetization multimediasearch news offshoreoutsourcingcompany opensource operating optimization pagerank parenting plug-ins powerset propertly ranking rss search searchengine searchengineland searchengineoptimization searchengines semanticweb seo seooptimizationindia seoservices serps service services sex skills socialnetworking spam squidoo survey traffic tveyes twitter uk universe usenet video videosearch viralmarketing web webdevelopmentcompanyindia website wolfram wolframalpha wordpress yahoo yahoo! youtube






