Member Avatar for mosesaaron

I saw many times that Google indexed my some pages not all pages. How can i get my all pages index from Google? Please suggest your point of view.

  • 9 Contributors
  • 8 Replies
  • 189 Views
  • 1 Week Discussion Span
  • Latest Post Latest Post by Dani

Dani AI

Generated

Good start — several replies (for example , and ) pointed to sitemaps, which help. Beyond that, the issues that actually stop individual pages from being indexed are usually more subtle. The checklist below covers the most common, often-missed causes and quick ways to confirm them.

Common causes (short explanations)

  • robots.txt or server rules blocking the path (even a single Disallow can hide many URLs).
  • Page-level noindex (meta tag) or an X-Robots-Tag header sent by the server/CDN.
  • Incorrect rel="canonical" pointing away from the page (Google then indexes the canonical instead).
  • Redirect chains or 302s that prevent a clean 200 or 301 resolution.
  • Orphan pages with no internal links — crawlers rarely discover them.
  • Thin/duplicate content where Google chooses not to index duplicates.
  • Server errors, timeouts or rate-limiting that cause crawl failures.
  • Content only rendered client-side (JS) and not visible to the crawler without rendering.

Quick diagnostics (run these from a terminal; replace example.com)

# robots.txt text
curl -s https://example.com/robots.txt

# headers (look for status, X-Robots-Tag)
curl -I -L https://example.com/suspect-page

# check for meta robots in the returned HTML
curl -s https://example.com/suspect-page | grep -i '<meta name="robots"'

Practical next steps

  1. Use server logs to confirm Googlebot actually requested the URL and what status code was returned.
  2. Fix any noindex, header, canonical or redirect problems you find.
  3. Ensure the page is linked from elsewhere on the site (one strong internal link is often enough).
  4. Improve thin pages so they provide unique value.
  5. After fixes, request a re-crawl (use your site’s URL-inspection / coverage tools) and monitor the “Excluded” reasons to see why Google skipped specific URLs.

If a specific URL still won’t index after these checks, post one example URL and the output of the curl -I call shown above and the access-log snippet showing Googlebot’s request.

Recommended Answers

All 8 Replies

Member Avatar for vanilla23

Make Google sitemap and submit into webmaster tools & Another HTML sitemap for visitors.

Member Avatar for devisrimari1

hi,
update your XML site map to web master tool and wait until Google will crawl your pages.

Member Avatar for patriciaevansss

Yes. Create a sitemap of your site and submit it to Google Webmaster. Wait for a moment till your pages get to be indexed. It will take some time but atleast you will be sure of the result. Having a sitemap is good for a site.

Member Avatar for rocco88

Site map and Link Building.

Member Avatar for Mohammed Ammar

Update your xml site tool to webtool master and create a site map of your site and submit it to google

Member Avatar for joe.jeson

Update or make site map of your site with google. and submit it into webmaster tools. Thank you.

Member Avatar for micheal_paul

Sitemap is used for fast indexing so create a new site map.

Member Avatar for Dani

When you do site:domain.com, it is NOT an accurate tool to measure how many pages on your site are indexed by Google. You need to use Google Webmaster Tools at www.google.com/webmasters/ to get a more accurate picture. Then, as has been suggested, create a Sitemap.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.