Google crawler frequency.

[devesh9392]

Hi

On my website i have almost around 25000 webpages(static).
when i go to google and enter

inurl:mysite.com

it shows only 1000 pages. these are the pages crawled by google.
Here i notice that some of my webpages have never been crawled or never been indexed.
Also some of my webpages haven't been crawled since july 10, while some other pages have been crawled very recently(9 sept).

BTW it is PR 4 website.

can i do anything so that google crawls some more pages.

[stymiee]

The largest factor in determining how many are indexed are the PR of the individual pages. Not the PR of the homepage. You'll need to make sure you get deep links to your site as well as spreading the PR from your homepage around as well.

Also make sure all of your pages can be reached by the search engines. Just because you can get to them in your browser doesn't mean their crawlers can get to them.

[devesh9392]

You'll need to make sure you get deep links to your site as well as spreading the PR from your homepage around as well.

Can you please tell me what do you mean by "deep links" ?
and how can i sprear pr from my home page ? (by linking all important pages to home page ? )

thnx.

[jbennet]

Is the correct META tags present?

[stymiee]

Can you please tell me what do you mean by "deep links" ?

A deep link is a link to an inner page in your site (e.g. not your home page).and how can i sprear pr from my home page ? (by linking all important pages to home page ? ) You can spread PR by linking to inner pages. Cross linking your pages is an important part of on site SEO.Is the correct META tags present?
Meta tags won't affect crawl rate. The most you can do is stop a page from being crawled and/or indexed.

[devesh9392]

Meta tags won't affect crawl rate. The most you can do is stop a page from being crawled and/or indexed.

do you mean if i have same meta tag keywords and description for all my pages,
it would be considered as spamming and google won't crawl any further ?

Thanks...

[devesh9392]

You can spread PR by linking to inner pages. Cross linking your pages is an important part of on site SEO .

does it mean i should have more than one link to reach any page in my website ?

[stymiee]

do you mean if i have same meta tag keywords and description for all my pages, it would be considered as spamming and google won't crawl any further ?Thanks...

No, it means that the meta robots tag should only be used to block content. It doesn't help it be crawled or indexed.does it mean i should have more than one link to reach any page in my website ? As long as it makes sense to have those links, then yes.