| | |
I want google to index forum threads
Please support our Search Engine Optimization advertiser: Search Engine Optimization Services
![]() |
We all know that google doesn't like to index dynamic pages. However, I just checked up on the latest daniweb.com pages indexed by google, and guess what I found?
Google has indexed just about every member's profile page, but not the forum threads! The member profile pages contain less original content, and contain the same number of variables in the URL (e.g. member.php?u=1 as opposed to showthread.php?p=100) Why is this, and how could I get google to index the important pages instead of the meaningless ones?
Google has indexed just about every member's profile page, but not the forum threads! The member profile pages contain less original content, and contain the same number of variables in the URL (e.g. member.php?u=1 as opposed to showthread.php?p=100) Why is this, and how could I get google to index the important pages instead of the meaningless ones?
•
•
Join Date: Sep 2003
Posts: 13
Reputation:
Solved Threads: 0
0
#3 Sep 12th, 2003
Google indexes my forums threads, perhaps you have a robots.txt that is filtering out showthread.php.
Im running phpBB, but I dont think that should matter. Definatly check to see if there is a robots.txt file anywhere in your public_html folder. If you find one, check to see if showthread.php is located anywhere.
Im running phpBB, but I dont think that should matter. Definatly check to see if there is a robots.txt file anywhere in your public_html folder. If you find one, check to see if showthread.php is located anywhere.
Nope, no robots.txt. I'm putting some more effort into this since a few weeks ago when I first posted, and it's getting a bit better. A number of threads are indexed now.
Jibtronic, have you tried using the phpBB search-engine friendly hack? It's awfully good. You can find it via phphacks.com and it's the one that uses mod rewrite and an .htaccess file.
It lets you convert all viewtopic.php?t=100 threads into URLs like t100.html because we all know how much google likes static URLs better than dynamic URLs.
I actually wrote my own version of this mod for my own use awhile back (when this forum ran off of phpBB). But I never released it. Guess someone else finally did
Jibtronic, have you tried using the phpBB search-engine friendly hack? It's awfully good. You can find it via phphacks.com and it's the one that uses mod rewrite and an .htaccess file.
It lets you convert all viewtopic.php?t=100 threads into URLs like t100.html because we all know how much google likes static URLs better than dynamic URLs.
I actually wrote my own version of this mod for my own use awhile back (when this forum ran off of phpBB). But I never released it. Guess someone else finally did
Google doesn't necessarily have certain variables such as ?id= blocked. What it is is that Google doesn't want to index URLs containing a session ID (that long value like 8482349809934 ...) ... if you don't know what I'm talking about, check out any page on Amazon.com 
In any case, Google doesn't block variables such as ?id= or ?sid= but rather any variable that has a value that resembles a session ID.
Regardless, I found out my problem. I was doing a google serch for site:www.daniweb.com daniweb to return all URLs in the daniweb.com domain that contain the word "daniweb" - basically to estimate how many of my pages are indexed with Google. Apparently my member profile pages just had the word "daniweb" more prominently than my other pages, which wouldn't display until I clicked on the "show all pages" link at the end of the Google search results.
Regardless, guests have now been prohibited from viewing member pages, so Google won't see this anymore anyways
site:www.daniweb.com daniweb

In any case, Google doesn't block variables such as ?id= or ?sid= but rather any variable that has a value that resembles a session ID.
Regardless, I found out my problem. I was doing a google serch for site:www.daniweb.com daniweb to return all URLs in the daniweb.com domain that contain the word "daniweb" - basically to estimate how many of my pages are indexed with Google. Apparently my member profile pages just had the word "daniweb" more prominently than my other pages, which wouldn't display until I clicked on the "show all pages" link at the end of the Google search results.
Regardless, guests have now been prohibited from viewing member pages, so Google won't see this anymore anyways
site:www.daniweb.com daniweb Last edited by cscgal; Mar 16th, 2004 at 2:05 pm.
vBulletin3 is exceptionally good for SEO purposes. Good choice, cscgal.
•
•
Join Date: Apr 2004
Posts: 7
Reputation:
Solved Threads: 0
Hi Brian.
Seeing you here suggests something about the value of the forum links.
By the way I can see GPR 3 on this very thread, so it is indexed.
Seeing you here suggests something about the value of the forum links.
By the way I can see GPR 3 on this very thread, so it is indexed.
![]() |
Other Threads in the Search Engine Optimization Forum
- Previous Thread: Tags on Posts
- Next Thread: Local search engine help
| Thread Tools | Search this Thread |
adsense advertising affordable airplane analytics apple audioanalytics audiosearch benefits bing biometrics blog blogs bug business codesearch consumersearch design development digital dynamicdigitalsignage engine enterprisesearch eric_schmidt facebook failure feeds flash flashwebsiteoptimizationtips gaudi gmail google googleanalytics googlelongersearchbox googlesearch imagerecognition imagesearch indexedpage india internet internetmarketingcompanyindia keyword keywords kumar laws leweb link marketing microsoft money motrin news nexidia no-follow opencalais optimizingforbing pagerank posts privacy ranking refresh revenue search searchengine searchengineoptimization semanticsearch semanticweb seo seocompany seooptimizationindia seoservices services sets sex silverlight sitesearch socialnetworking space stalking sullivan system testing tools travel tweetnews twitter video videosearch viralmarketing wave web webdesignindia webmarketingcompanyindia webmaster website wolfram wolframalpha yahoo yahoo! youtube






