Bots & .htaccess
The index page of my site is redirected permanently to another page on my site using .htaccess, I'm messing about with IBP9's spider simulator to see how a search engine would see it; apperently this is what they'd see from the index page:
I've changed the index page (it was totally blank) to have a hyperlink and note to the redirected page, still, the HTML above is all a spider sees.
If I spider the redirected page it's alot more fruitful, but most of my hyperlinks elsewhere (like the one in my signature :P) link directly to the root directory, so as they hit the redirect.
Is this ACTUALLY what the spider is seeing? and can I fix this problem without not using .htaccess?
Matt
MattEvans
Veteran Poster
1,386 posts since Jul 2006
Reputation Points: 522
Solved Threads: 64
Ahh.. the problem was simple, the .htaccess redirect went to an index.html page with the above html; I think that page was provided with YaBB; because I don't remember writing it.
Still, problem solved, I just changed the redirect.
Matt
MattEvans
Veteran Poster
1,386 posts since Jul 2006
Reputation Points: 522
Solved Threads: 64
