Member Avatar for tapweld

hello to All my friends.. i am facing issue related to GSC. the errors are excluded by noindex tag
Page With Redirect, Soft 404, Blocked by Robotstxt, Redirect Error, can anybody tell me or guide me to resolve the issue? how i can resolve these errors?

Edited by Dani because: Link to website removed because it is irrelevant to the question being asked
  • 2 Contributors
  • 1 Reply
  • 124 Views
  • 1 Week Discussion Span
  • Latest Post Latest Post by FilipKappa

Dani AI

Generated

A compact triage checklist and practical checks to complement 's summary for . The items below focus on root causes that are often missed and give a short, repeatable workflow for each GSC status.

Start with one URL at a time: run a URL Inspection live test in Search Console, then fetch headers and chain locally with curl -I -L https://example.com/path. Look at the final HTTP status, any X-Robots-Tag, the Location header(s) for redirects, and the HTML head for meta name="robots" and rel="canonical". Use the robots.txt tester in GSC to simulate crawling for that path. Check server logs and CDN/firewall rules if the URL times out or returns 5xx.

Common hidden causes and fixes (concise):

  • Noindex shows but you did not add one: check for X-Robots-Tag on the HTTP response, staging/sitewide plugin settings (SEO plugin "noindex" toggles), tag managers injecting meta tags, or environment config that flips to noindex on non-production builds.
  • "Page with Redirect": this is usually expected when a URL permanently moved. Confirm the redirect target is reachable, avoid redirect chains and loops, and prefer a single 301 to the final URL. Ensure the target is not blocked by robots.txt.
  • Soft 404: Google treats pages with 200 + "not found" content or thin "no results" pages as soft 404s. Decide to restore content, return a real 404/410 for removed pages, or 301 to a closely related page. Do not silently redirect many deleted URLs to the homepage.
  • Blocked by robots.txt: confirm the exact path and user-agent rules. Remember robots.txt blocking prevents Google from seeing meta tags, so unblock first if you need Google to re-evaluate the page.
  • Redirect error: look for DNS failures, TLS mismatches, malformed Location headers, or server-side redirect loops. Use server logs and curl traces to pinpoint.

After fixes, run a live test in URL Inspection and trigger re-crawl for the specific URLs; monitor Coverage and server logs for recurrence.

Member Avatar for FilipKappa

Firstly, let's understand the errors you're facing:

"Excluded by noindex tag" error means that Google has detected a "noindex" tag on your webpages, which instructs Google not to index the page. If you want Google to index these pages, you should remove the noindex tag from your webpages.

"Page with Redirect" error occurs when Google detects a page that is redirecting to another page. This may happen when a page is moved or deleted and you want to redirect users to a new page. You can fix this error by ensuring that the redirect is set up correctly, and that the new page is accessible.

"Soft 404" error occurs when a page returns a 200 HTTP status code, indicating that the page is found, but the content on the page suggests that the page does not exist or is an error page. You can fix this error by ensuring that your page returns the correct HTTP status code (e.g., 404) for pages that don't exist.

"Blocked by robots.txt" error occurs when Google is unable to crawl a page because it has been blocked by the robots.txt file on your website. You can fix this error by updating your robots.txt file to allow Google to crawl the pages.

"Redirect error" occurs when Google detects a redirect that is not working properly. You can fix this error by ensuring that the redirect is set up correctly, and that the new page is accessible.

Now, let's move on to how you can resolve these errors on your website

Excluded by noindex tag: You can check your webpages for the noindex tag and remove it if you want Google to index these pages.

Page with Redirect: You can check the redirect and ensure that it is set up correctly, and that the new page is accessible.

Soft 404: You can ensure that your page returns the correct HTTP status code (e.g., 404) for pages that don't exist.

Blocked by robots.txt: You can update your robots.txt file to allow Google to crawl the pages.

Redirect error: You can check the redirect and ensure that it is set up correctly, and that the new page is accessible.

To fix these errors, you can use the Google Search Console to identify the specific pages that are affected and make the necessary changes.

After your fixes remember to run a re-index request via GSC or re-submit the entire sitemap

Edited by FilipKappa
commented: wow ty +0
Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.