Member Avatar for Dani
Dani 5,664 The Queen of DaniWeb

The new Crawl Stats in Google Search Console shows a breakdown of how much googlebot recrawls existing content for refreshing its index, and how much is discovery of new content.

Has anyone been working on increasing the rate of new content and seeing that correlate to a linear increase in traffic?

  • 1 Contributor
  • 0 Replies
  • 209 Views

Dani AI

Generated

As observed, Search Console’s crawl reports that separate “new discovery” from “recrawl” make it possible to measure how much of Googlebot’s activity is finding fresh pages. That visibility is useful, but increased discovery does not automatically produce a strictly linear increase in organic traffic.

Traffic growth depends on demand and relevance as much as discovery. New pages will be discovered faster when publishing at scale, but if those pages target low‑volume queries, are thin or duplicate, or lack internal links and backlinks, impressions and clicks will remain low. Expect a time lag (commonly several weeks) while pages index and settle in rankings; expect diminishing returns as topical coverage grows and competition increases. Crawl budget matters mainly for very large sites; for most small/medium sites it is less of a limiter than content quality and relevance.

Recommended experiment (practical, repeatable):

  1. Establish a baseline (4–8 weeks): weekly impressions, clicks, avg position from Search Console; organic sessions and page-level performance from analytics; weekly count of newly discovered URLs (from crawl data or a publish log).
  2. Select a test cluster and a control cluster. Ramp new content in the test cluster at a fixed cadence (for example 5 posts/week) while leaving the control unchanged. Apply consistent quality rules (target intent, unique title/meta, adequate length, internal links to pillar pages).
  3. Monitor indexation and rankings weekly; evaluate impact at 6–12 weeks. Plot new-pages-per-week vs weekly organic sessions and look for lagged correlation rather than an immediate one.
  4. Analyze: check impressions, clicks, CTR, ranking changes, and whether new pages cannibalize existing ones.

If discovery rises without traffic, check indexation status, robots/meta directives, canonical tags, sitemap inclusion, title/meta optimization, and whether the topics actually have search demand. In many cases targeted publishing plus pruning or consolidation of low‑value pages produces more lift than raw volume.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.