943,701 Members | Top Members by Rank

Jul 12th, 2005
0

.htacess Is Not Working

Expand Post »
My Robots.txt Was Not Blocking Out Sites From Any Search Engine. A Friend Suggested That I Should Create An .htaccess File

During A Web Search Using Google, Yahoo, Excite, Msn, Altavista, Hotbot, Infoseek, Lycos, Overture, Ask Jeeves, Teoma, Or Other Search Engines, I "do Not" Want These Sites To Be Listed. Can You Help Me To Improve My Search So These Cannot Show?

The Administrators Will Not Remove The Postings.
Attached Files
File Type: zip HTACCESS.zip (1.6 KB, 16 views)
Similar Threads
Reputation Points: 10
Solved Threads: 0
Newbie Poster
design1 is offline Offline
1 posts
since Jul 2005
Sep 4th, 2005
0

Re: .htacess Is Not Working

if You're wanting to totally Block ALL Robots, from MY understanding of the file, Youshould only need these two lines.

user-agent: *
disallow: /

otherwise, Note the changes I made in Your htaccess file
post back, lemme know how things go for ya
Attached Files
File Type: zip Updated htaccess.zip (1.6 KB, 8 views)
Reputation Points: 16
Solved Threads: 0
Light Poster
jusCk is offline Offline
32 posts
since Aug 2005
Sep 21st, 2005
0

Re: .htacess Is Not Working

If you are using a global header you may try using this meta tag as well:
<META NAME="ROBOTS" CONTENT="INDEX,NOFOLLOW">
But really you really only need to use that when you have files in a directory that you don't want to put in your robots.txt file, and want to have a tidy robots file.
not sure what using .htaccess gains you, unless you are willing to play around with rules based on user agents, which may end up blocking alot of traffic you don't really want to and also would take alot of work to keep up with all the different robot agents out there. Not trivial.
if your friend meant to do an .htaccess to password protect it that's a different matter and kind of a different issue, but what jusCk said in his post about the robots.txt should really be sufficient unless you're running into bots with bad etiquette.
Reputation Points: 10
Solved Threads: 0
Newbie Poster
bsmith is offline Offline
9 posts
since Sep 2005

This thread is more than three months old

No one has posted to this discussion for at least three months. Please let old threads die and do not reply to them unless you feel you have something new and valuable to contribute that absolutely must be added to make the discussion complete. Otherwise, please start a new thread in this forum instead.
Message:
Previous Thread in Linux Servers and Apache Forum Timeline: mod rewrite problem (tomcat with od_jk as well)
Next Thread in Linux Servers and Apache Forum Timeline: Mod_Rewrite help!





About Us | Contact Us | Advertise | Acceptable Use Policy
Forum Index | Build Custom RSS Feed


Follow us on Twitter


© 2011 DaniWeb® LLC