Member Avatar for Mr.'BackUp'

Hi guys,

My site is being visited almost daily by yahoo,google and msn robots. Given that, is it still worth resubmitting other pages of my site?

Cheers!

  • 12 Contributors
  • 12 Replies
  • 462 Views
  • 10 Months Discussion Span
  • Latest Post Latest Post by newonlineinfo

Dani AI

Generated

A short modern update that builds on the thread: several earlier replies from , and pointed toward leaving discovery to crawlers. That remains the sensible baseline, but current webmaster tools add safe, targeted ways to monitor and nudge indexation without repeated manual “submit URL” pushing. Use an XML sitemap and Search Console to watch coverage and to request recrawl for a few high‑priority URLs; sitemaps remain the scalable signal for many URLs. (developers.google.com)

Practical workflow now: register and verify the site in Google Search Console, submit a clean sitemap (canonical URLs only), and use the URL Inspection tool sparingly for individual, time‑sensitive pages. Google’s Indexing API is strictly for short‑lived types (job postings and live broadcasts) and is not a general bulk‑indexing shortcut; the old sitemap “ping” endpoint is deprecated and should not be relied on. For large batches, keep sitemaps accurate rather than resubmitting pages one‑by‑one. (developers.google.com)

For engines outside Google, real‑time notifications are available. IndexNow (and Bing’s submission APIs) let sites notify participating search engines when pages are added/updated or removed; the protocol supports batching and key verification and is designed to be automated from CMS or publish workflows. Example (simple GET ping): 

https://www.bing.com/indexnow?url=https://example.com/new-page.html&key=YOUR_KEY

(indexnow.org)

If a page still won’t index despite being reachable, inspect technical causes: robots.txt and X‑Robots/rel=canonical rules, HTTP status codes and redirect chains, sitemap coverage, and low‑value duplicate URLs that waste crawl budget. Improving site health and useful internal/external links raises “crawl demand” and is the reliable way to get pages indexed faster. (developers.google.com)

Bottom line: avoid mass resubmissions. Rely on crawlability, clean sitemaps, Search Console diagnostics (or IndexNow/Bing APIs for non‑Google engines), and targeted recrawl requests for a handful of priority pages.

Recommended Answers

All 12 Replies

Member Avatar for jewboy

IMHO, Manual submission is dead. If the bots are finding your homepage - as they are - and your homepage links properly to your internal pages - then you have nothing to worry about.

Member Avatar for TopDogger

I second that. Repeated submissions to the major search engines is worthless. Once they find your home page, they will find the rest of your site.

Be patient with Google. It can sometimes take weeks before a new site shows up in Google, even when the site is being indexed.

Member Avatar for mddv

it is best if you just leave to the spiders. there is no need to resubmit if your being spidered everyday.

Member Avatar for sarika_mosaic

You don't need to submit to Search Engines at all. They are crawler based and submitting manually to SE won't help. You just have to submit to directories and SE will take your webpages from the directories. Make your internal navigation strong and do emphasize on creating sitemap if you don't have one.

Member Avatar for fromthe5

Spiders follow links. As long as there is a crawled link to you page, be it internal if you've already been spidered, or external, the spider will get there. Now there's nothing wrong with getting an external link to a specific page either. That might get your page crawled quicker than waiting for a deep crawl. We've all seen sites where an internal page has a higher PR than the home page. It just has more or better links pointed at it.

Member Avatar for seo_expert

with google XML site map, you really don't need to submit inner pages to SEs.

Google will automatically will crawl all the urls in your xml site map..

Member Avatar for brainpulse

with google XML site map, you really don't need to submit inner pages to SEs.

Google will automatically will crawl all the urls in your xml site map..

I dont find Google Site MAP Effective.

Member Avatar for Dani

I don't either ... remember, Google Sitemaps will not get more pages indexed than if you weren't using it. It is just an aid to give google a smarter crawl by specifying which pages you want Google to focus more on. Of course, whether those pages are actually crawled and indexed is dependant upon your pagerank and lots of other factors.

Member Avatar for findinforums

don't submit your pages, just get few good links googlebot wil
l come and crawl them and they'll get indexed eventually.

Member Avatar for Dani

Yeah, manual submission hasn't really been necessary since Y2K times.

Member Avatar for wll6568

My advise is, not to submit at all.

Member Avatar for newonlineinfo

Hi guys,

My site is being visited almost daily by yahoo,google and msn robots. Given that, is it still worth resubmitting other pages of my site?

Cheers!

Hi,

Please do not resubmit and make your website a spam to the search engines :mrgreen:

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.