0

if anyone knows, how long spiders/googlebot/adsensebot crawling on a single page of a web ?
3 second ? 10 sec ? 15sec? 30sec ? or maybe 60sec?

or it's depending on how many content/words from the page?

i specific the question like:
how long the spider crawling on a single page content with 500 word of a web?

10
Contributors
9
Replies
10
Views
7 Years
Discussion Span
Last Post by rafiello
0

Most probably it should be depending on how is your page appearing in front of the bot. The bot must have been set alongwith all the rules and regulations of google indexing. If the page is perfect, it might be staying for a longer time than others....
Just a thought, not sure about it.

0

if anyone knows, how long spiders/googlebot/adsensebot crawling on a single page of a web ?
3 second ? 10 sec ? 15sec? 30sec ? or maybe 60sec?

or it's depending on how many content/words from the page?

i specific the question like:
how long the spider crawling on a single page content with 500 word of a web?

500 words! Man, the spider crawls through that like in a fraction of a zillionth of a second.

0

In my own experiences, the crawling frequency would depend on the updating frequency of your pages and the PR of linking pages. :)

Have a nice day,

0

I think there really is no exact answer to that question. I guess the more content a page has the more time a crawler would spend on it. Obviously if the content is constantly being updated and there is plenty of content on your site then the crawlers will spend a little more than 5 seconds on it... : )

0

Its utterly depends on the page size which may contains more images, videos, articles and so on.

0

as far as i think bot decides it depending upon the size of your web page if its greater it may take even more 60 sec.

-1

It's all dependent on the PR of the site. E.g. If you are CNN (PR10) the spiders come every half an hour. PR9 1-2 hours. PR8 4-8 hours, PR7, 1-2 days, PR6 4-7 days, PR5 10-15 days, PR4....etc

This topic has been dead for over six months. Start a new discussion instead.
Have something to contribute to this discussion? Please be thoughtful, detailed and courteous, and be sure to adhere to our posting rules.