You should use a robots.txt file on your index pages. It's a txt file that allows search engines to spider your site. You can use commands like: <meta name=”robots” content = “index, follow”> which will crawl your entire site, so id get familiar with the disallow command too.

More info here:

http://www.google.com/support/webmas...n&answer=40360

Thanks a ton for this, I'll look into it

You can fetch your forum posts through rss however if you've a blog it would be much easier to promote your content.

Most forum software generates rss feeds so you could go to feeddigest or similar and group the feeds into one single feed. Then burn the feed at feedburner.

Andrew

Having lot of incoming links (i.e. a popular site) helps a lot to get your forum indexed. Using a forum package that is SEO friendly from the start also helps.

You can also create a Google Site Map which lists all the pages on your site (including the forum posts).

Despite the advice above, having a robots.txt file normally doesn't help get a site indexed. As Google states, "If you want search engines to index everything in your site, you don't need a robots.txt file (not even an empty one)".

As DaveSinkula loves to point out to me, RSS feeds were designed with blogs in mind and therefore don't translate so well into forums ... the only way to set it up while conforming to RSS standards is based on new threads as opposed to new posts or last updated threads, which can make them lose partial functionality for those who want to use the feeds as a way of following the forums.