Member Avatar for Allison2009

I find something strange about Google Indexing. More than half of the products were indexed by Google sometime back. They reduced the indexing pages and after a while (in a week), only 1/4th of the indexed pages were shown as getting indexed.

But when I search for a product, even the Newer Product which is not even in the sitemap, is showing in the 1st page of Google. For this product, not even a single link has been created.

I don't really understand what it is.

  • 20 Contributors
  • 23 Replies
  • 229 Views
  • 1 Year Discussion Span
  • Latest Post Latest Post by claydcousta

Dani AI

Generated

Short answer for : the number Google reports as “indexed pages” and whether an individual product appears in search are driven by different systems. Google de-duplicates similar URLs, chooses canonical versions, and treats sitemap entries as hints — so your sitemap count can fall while a single product page still ranks for its query. The raw "indexed pages" figure (and the site: operator) are rough estimates and will fluctuate.

Quick, practical checklist to diagnose the gap:

  • Use Google Search Console's URL Inspection (Coverage) to see the exact status: indexed, blocked, canonicalized, or crawled-but-not-indexed. ( referred to Webmaster tools earlier.)
  • Check for accidental blocks: robots.txt, X-Robots-Tag headers, or meta noindex on templates.
  • Look for rel=canonical or duplicate/parameterized URLs that cause Google to pick a different canonical.
  • Inspect server logs for Googlebot hits and HTTP status codes (200 vs 3xx/4xx/5xx).
  • Fix thin or duplicate product content — unique titles, descriptions, and schema.org/Product markup help.
  • Submit an XML sitemap with canonical URLs and monitor the Coverage report rather than relying on total counts.

Two tiny examples you can use if needed:

<meta name="robots" content="index,follow">
User-agent: *
Disallow:
Sitemap: https://www.example.com/sitemap.xml

Putting priorities in order: technical blockers first (robots, headers, canonicals), then content quality, then internal links and natural external links (as and suggested). Short-term ranking of a new product can look like a “honeymoon” (as called it) but sustained visibility depends on having a canonical, crawlable URL with unique content and signals from internal/external linking. Track impressions and clicks in Search Console and traffic in analytics — those are far more useful signals than a fluctuating indexed-count.

Recommended Answers

All 23 Replies

Member Avatar for InsightsDigital

Google has a very interesting and ever changing algorithm. Thus, pages with new content may get indexed much more than statis ancient pages but there are other nuisances as well. http://www.google.com/webmasters/

Member Avatar for Nichetraffic

I don't think this is a new concept. new sites tend to rank very well with google and then after a few weeks they disappear. It's almost like a honeymoon period

Member Avatar for redesignunit

if you are using Fresh content in your site so you will getting index early.

Member Avatar for Allison2009

I don't think this is a new concept. new sites tend to rank very well with google and then after a few weeks they disappear. It's almost like a honeymoon period

But what about the already indexed pages. Do you mean to say that the original indexed pages are dropped by Google and the new ones are added. Would it do even without a sitemap better than those with a sitemap.

Member Avatar for PaylessSEO

You are right, i have also noticed it several times. I also don't understand why and how it happens.

Member Avatar for Financial-post

i know that google makes the index like 2 weeks time!

Member Avatar for Nichetraffic

But what about the already indexed pages. Do you mean to say that the original indexed pages are dropped by Google and the new ones are added. Would it do even without a sitemap better than those with a sitemap.

For large websites, Google does not index all of you pages. It'll take up too much server space

Also remember the concept of sandboxing.

That old pages are disappearing and new pages indexed and ranking well does not mean that one page is being replaced in the index by another

Member Avatar for jonash23

I just assume your new indexing page contain more higher LSI quality compare to other webpage you have on your site

Member Avatar for patmaro

I also noticed that google is impredictable with new websites as they are discovering you so they might index some pages and leave out others. Also, if your website is really big, don't expect them o index all of it

Member Avatar for earthtita

I think that when google index a website is different that when they finish their engine update and how the website will be indexed permanent. Maybe for internal linking they can index first other pages different to the index.

Member Avatar for AirForceOne

Of course, Google does love fresh contents. So, it would give a higher rank for new and fresh contents. But, if you want to keep your ranking, you should build backlinks for those pages. :)

Have a nice day,

Member Avatar for Financial-post

I know that google is index,good links, if you inbound your link to a low pr website, no use!

Member Avatar for daisy192

i also confused what will happen with new page some say always new page is index so what about other pages in site. and if we also make some changes in old pages and its not index then its also not good for our site so please tell me properly about it.

Edited by jay 11 because: removed fake signature - you may add a real sig in the DaniWeb Control Panel
Member Avatar for joelchrist

I am into SEO field more than 4 years, but still Google indexing issue is a great mystery to me.

Member Avatar for B.Williams

I think this problem is happening with many people. Dont know exactly what Google is thinking. Every new website have to faced this kind of problem and some how every website get indexed soon. So dont worry

Member Avatar for 3oltan

To improve the indexing process you should make sure there are some links pointing to your domain. Googlebot works like a spider - visits websites and continue spidering the links on the page. This means that Googlebot will not index your website until there will at least one link pointing to your domain name.

Member Avatar for skseo

i never understand the Google index strategy some time it happen fast and some time we have to wait for a long time.

Member Avatar for bruceshan

Still google indexing problem on new sites are nightmare to the seo newbies.

Member Avatar for digital29

Takes time...
My blog posts usually appear in search results almost immediately, but are 100% indexed in 2-3 days (info from webmasters tools)

Member Avatar for gusang

Other of the many unknown factors of Big G.

Member Avatar for John Ripple

is there any different of google indexing or indexing.

Member Avatar for claydcousta

I read in some forum google does index the sites having adsense but just that fact does not boost ranking. A site has to meet the criteria set forth by google or other search engines like yahoo and msn, in order to get high ranking.

Member Avatar for claydcousta

Google indexing means that google bot has crawled or index your web pages.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.