Hello

I have one website for which I can see in the Google Webmaster only half of the total URL has been indexed. Can anyone suggest me what might be the reason my website pages are not being indexed? I have tried everything and though got nothing. Please help me out. Website is:

Dani AI

Generated

Good pointers from and about robots/sitemaps, and a fair reminder from that patience sometimes plays a role. ’s question about site age is also relevant. Below is a concise, prioritized checklist of less-obvious causes that commonly explain “only some pages indexed.”

  • Meta/X-Robots and canonical issues: misplaced noindex meta tags or an incorrect link rel="canonical" (CMS bug or template error) will keep pages out of the index even when a sitemap exists. Example canonical markup:

    <link rel="canonical" href="https://example.com/this-page" />
  • HTTP status, redirects, and header-based blocking: crawlers need a clean 200 (or proper 3xx) chain. Server headers and X-Robots-Tag can block indexing. Quick header check:

    curl -I https://example.com/some-page
  • Search Console diagnostics (Coverage / URL Inspection): look for reasons under “Excluded” — common labels are “Crawled - currently not indexed,” “Discovered - currently not indexed,” and “Duplicate, submitted URL not selected as canonical.” Each label points to a different fix (wait/improve content, improve discovery/internal links, fix canonicals respectively).

  • Rendering and JS: content loaded only after heavy client-side JS can be invisible to Google’s initial render. Use the URL Inspection live test / rendered HTML to confirm the searchable HTML contains the main content.

  • Hosting, security, and user-agent handling: WAFs, CDNs, or security plugins sometimes block Googlebot IPs or return intermittent 4xx/5xx responses. Crawl logs or server access logs will reveal failed fetches or blocked user agents.

  • Internal linking and orphan pages: pages not linked from the site or excluded by bad canonicals are hard to discover regardless of sitemap presence.

When robots/sitemap basics are already covered (as noted above), the combination of header inspection, a few URL Inspections, and a short crawl-log review usually exposes the root cause. If those checks are clean, a focused audit of canonicalization and rendering is the next practical step.

Recommended Answers

All 4 Replies

How long has it been? Certain cases big G takes bit longer to index properties. Maybe wait it out.

Also they index crawl on webmasters can do it but I think you already did that. right?

Hi Lisa, Scott is Here

I have checked that your domain is gicree[dot]com is more than 16months old. For checking your issue Google doesn't indexed your website or your website Pages.

***You need yo tell me when did you created you website.?
When you last submit your website for google indexing.??
Last when did you make any changes in your website??

Please provide the correct anwser then i might help you to reslove your issue.

Hi,

Some common advises,

  1. Create a sitemap file and sumbit it to websmaster tools.
  2. Check for duplicate contant and remove those pages.
  3. Check your robots.txt file and no follow attribute on pages.
  4. Create a HTML sitemap file, and that will help the users to navigate also the search engines will crawl the pages.

Thank you.

Hi,

Check your robots.txt file and sitemap.xml.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.