Member Avatar for tadisaus2

Hello,

I have downloaded gsitecrawler to run sitemap on my dating sites. Is there another good Google sitemap generator that can run sitemap for my dating sites?

Because gsitecrawler takes a long time to create sitemap for my dating sites (about 2000 profiles) so I am looking for a better one.

Thanks.

  • 3 Contributors
  • 2 Replies
  • 84 Views
  • 1 Day Discussion Span
  • Latest Post Latest Post by bikercyber

Dani AI

Generated

As described, sitemap generation for a dynamic dating site with a couple thousand profile pages can be slow when using a crawler that rescans the whole site each run. 's suggestion of an online generator is handy for quick checks, but for sites with frequently changing user content the most reliable option is server-side generation: export canonical URLs from your database and build a sitemap index made of multiple gzipped sitemap files. That approach scales and updates much faster than re-crawling.

A practical workflow:

  1. Export canonical URL + lastmod for each profile from the database.
  2. Split the list into chunks (each sitemap <= 50,000 URLs and <= 50 MB uncompressed; see the sitemap protocol).
  3. Generate valid XML sitemaps for each chunk, compress to .xml.gz, and create a sitemap index that references them.
  4. Place files on the server, add a Sitemap: entry in robots.txt and submit the index in Search Console.
  5. Automate: run full rebuilds infrequently and incremental updates (only changed chunks) on a schedule or when profiles change.

Tips and cautions: gzip sitemaps to save bandwidth; ensure each sitemap URL returns HTTP 200; use accurate lastmod timestamps; avoid indexing low-value or duplicate profile pages (use noindex or canonical tags where appropriate); test the index in Google Search Console. For protocol details and limits, see the official sitemap documentation: sitemap protocol.

Recommended Answers

All 2 Replies

Member Avatar for mauconline

There is www.xml-sitemaps.com its a free online tool that does a great job. No need to download anything, just type in your url and it does the rest! Hope that helps.

Member Avatar for bikercyber

Thank you for your sharing.

commented: sig spam -2
Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.