About DaniBot
When our community members post links within their posts or specify their websites in their business profiles, we send out our DaniBot to check them out. For each link we are told about by our community, our servers periodically make an HTTP HEAD request to make sure that the URL still exists. If it doesn't, for the benefit of our website visitors who may encounter the link within a forum post, we redirect visitors to a notice instead of stripping out the link to preserve the integrity of the post. If it does, it gets added to a queue to issue a second HTTP GET request to generate a screenshot of the URL that visitors can then see when they hover over the link within the post.
You can identify the bot in your logs by its list of recognized IPs and user-agent string:
Mozilla/5.0 (compatible; DaniBot/1.0; +https://www.daniweb.com/welcome/bots)
About DaniBot-Links
Our members can make use of our Backlink Auditor tool by supplying a list of URLs presumed to include a link pointing to a website. Our auditor then utilizes DaniBot-Links to issue HTTP GET requests to check each URL for a valid backlink. For each backlink that is found, an HTTP GET request is made to the URL being linked to, so that links pointing to potentially broken URLs can be added to the audit. If you would like us to not check parts or all of your website, you may block DaniBot-Links in your website's robots.txt file.
Note that DaniBot-Links never crawls the web by following links, nor inspects any webpages that our members have not explicitly requested through our tool. Nevertheless, we respect the Crawl-Delay directive in the event that multiple URLs on the same domain happen to be requested simultaneously.
You can identify the bot in your logs by its list of recognized IPs and user-agent string:
Mozilla/5.0 (compatible; DaniBot-Links/1.0; +https://www.daniweb.com/welcome/bots)Backlink Auditor