Search Engine...

How can I exclude the search engine bots on a Coldfusion website?

Please support our Search Engine Optimization advertiser: Get a Free SEO Analysis!

Thread Solved

•

Join Date: Dec 2008

Posts: 13

Reputation: mheidi is an unknown quantity at this point

Solved Threads: 0

mheidi

Offline

Newbie Poster

How can I exclude the search engine bots on a Coldfusion website?

Jul 12th, 2009

Does anyone know if it's possible to exclude the search engine bots by using a robots.txt file on a Coldfusion website just like an HTML site?
Thanks,
Heidi

•

Join Date: Feb 2004

Posts: 2,217

Reputation: GrimJack will become famous soon enough

Solved Threads: 16

GrimJack

Offline

Nearly a Posting Maven

Re: How can I exclude the search engine bots on a Coldfusion website?

Jul 12th, 2009

From the definition:

•

The robots.txt file can be used to stop a search engine spider from crawling all or part of your site. Create a robots.txt file in the main folder of your site which will direct the search engine spiders what they may and may not search. Spiders generally look for this file before doing anything.

this seems to imply that it will. I know that it works for databases and such so I can see no reason that Coldfusion websites would be any different.

Imagine a world without hypotheticals....
You can have my book when you pry it from my cold, dead fingers.

•

Join Date: Dec 2008

Posts: 13

Reputation: mheidi is an unknown quantity at this point

Solved Threads: 0

mheidi

Offline

Newbie Poster

Re: How can I exclude the search engine bots on a Coldfusion website?

Jul 12th, 2009

Thanks so much for your response. I just wasn't sure if the robots.txt worked for databases.

•

Join Date: Jul 2009

Posts: 5

Reputation: gklandes is an unknown quantity at this point

Solved Threads: 0

gklandes

Offline

Newbie Poster

Re: How can I exclude the search engine bots on a Coldfusion website?

Jul 24th, 2009

•

Originally Posted by mheidi

Does anyone know if it's possible to exclude ... on a Coldfusion website just like an HTML site?...

It might help to clarify that Coldfusion generated pages ARE html regardless of the ".cfm" extension. Coldfusion is simply a tool for dynamically generating the HTML (or XML or even PDFs and images, for that matter). CF on the server creates the content and then sends it out to the browser which interprets it in the same way that it interprets any other data sent from a server. In that respect CF is like PHP, ASP, ROR, etc. They all create HTML on the server.

The robots.txt file is one way to do it. You can also include a META tag in the HEAD of your page.

 Help with Code Tags 
 html Syntax (Toggle Plain Text) 
<html>
<head>
<title>...</title>
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
</head>
<body>...</body>
</html>
<html>
<head>
<title>...</title>
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
</head>
<body>...</body>
</html>

•

Join Date: Jul 2009

Posts: 7

Reputation: nherbal is an unknown quantity at this point

Solved Threads: 0

nherbal

Offline

Banned

Re: How can I exclude the search engine bots on a Coldfusion website?

Jul 26th, 2009

Just visit google webmaster tools & generate robots.txt for the same

•

Join Date: Jul 2009

Posts: 5

Reputation: gklandes is an unknown quantity at this point

Solved Threads: 0

gklandes

Offline

Newbie Poster

Re: How can I exclude the search engine bots on a Coldfusion website?

Jul 26th, 2009

Google WM Tools is a good but a quick fix. Eventually you will want to understand how they work and how to use them more effectively. You can get a good grounding in them at ...
http://www.robotstxt.org/