ok there... fellas.
I have used this site - http://tools.summitmedia.co.uk/spider/ to spidy my site.
My site is www.thalforum.com and when i put this to spider.. i get all broken links.
However when I put www.thalforum.com/forums in th spidy tool.. then i get all pages spidered in html
Q: what do i need to do in order to spider all my pages by entering www.thalforum.com since most spiders actually visit the main page first.
everything else is just fyne.