Does anyone know if it's possible to exclude the search engine bots by using a robots.txt file on a Coldfusion website just like an HTML site?
Jump to Post
From the definition:
The robots.txt file can be used to stop a search engine spider from crawling all or part of your site. Create a robots.txt file in the main folder of your site which will direct the search engine spiders what they may and may not search. Spiders generally …
All 5 RepliesReply to this topic
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, learning, and sharing knowledge.