954,359 Members — Technology Publication meets Social Media
Username:
Password:
Lost login information?
Have something to say? Contribute New Article Reply to this Article

How often Google spidered a site?

Hy all.
I was wondering, if there is any way, to check, when Google spidered a site X. (X is not my site), or how often Google is Google spidering this site X?

I have an idea for start...I dont know if it is ok.. but in Google search often appears url: in cache. And you can see, when the cache was created. Well.. if you have to consecutive times from Google cache, it is simple to calculate how often (aproximately) Google is visiting this page?

Any ideas?

paptamas
Newbie Poster
11 posts since Aug 2009
Reputation Points: 10
Solved Threads: 0
 

Hi
Spider activity is usually related to the amount of links to your site. More links would usually equal a fresher cache of your home page.

Johny22
Newbie Poster
6 posts since Feb 2010
Reputation Points: 8
Solved Threads: 0
 

I am not sure... But I think you can keep track of that in Google Webmaster tools. I know that Google updates it's Ranking about every 3 months. So, the next one should be by the end of March if I am not wrong.

jennypitts
Junior Poster
161 posts since Sep 2009
Reputation Points: 13
Solved Threads: 1
 

It depends how often you often the content of your site. The more often you update the site, the more the spider will crawl.

InsightsDigital
Posting Virtuoso
1,761 posts since Jun 2009
Reputation Points: 68
Solved Threads: 9
 

it totally depends on PR of a site & how early content is added or changes. google crawl static site once in a month while some news site as CNN crawled every minutes

drg312
Newbie Poster
14 posts since Feb 2010
Reputation Points: 10
Solved Threads: 0
 

Well..I know that it depends on many circumstances, but is there any way to check? For a site that is not mine?

Thanks

paptamas
Newbie Poster
11 posts since Aug 2009
Reputation Points: 10
Solved Threads: 0
 

All about related to content and site map so update it regular.

redesignunit
Posting Pro in Training
435 posts since May 2009
Reputation Points: 7
Solved Threads: 10
 

Yes, depends on ammount of links (PR) and frequency of updates.

xtreme6
Newbie Poster
3 posts since Feb 2010
Reputation Points: 10
Solved Threads: 0
 

i don't think so

Tanha Karim
Light Poster
40 posts since Feb 2010
Reputation Points: 10
Solved Threads: 0
 

I agree with that of the ''Frequency of quality Content''. My site got an improved PR within the first 3 months of hosting the site, and its gradually in the top ten of Google.

Post frequently, and be conscious of the title keywords too.

dammy2007
Newbie Poster
20 posts since Dec 2009
Reputation Points: 10
Solved Threads: 0
 

Does adding an RSS feed help (from another site) so it looks like you are adding content all the time?

extremeb
Newbie Poster
20 posts since Aug 2010
Reputation Points: 10
Solved Threads: 0
 

Hi, paptamas

Generally speaking, Google bots would frequently crawl those sites with higher PR(above 4) and more frequent updates. You could know if Google is crawling your sites or not via the admin area of your CMS usually.

all the best,

AirForceOne
Posting Pro in Training
457 posts since Jun 2009
Reputation Points: 19
Solved Threads: 15
 

More links to your site would usually equal a fresher cache of your home page.

mackone
Posting Pro
587 posts since Aug 2008
Reputation Points: 65
Solved Threads: 10
 

This article has been dead for over three months

Post: Markdown Syntax: Formatting Help
You