I can't find a section related to .htaccess, so I'm posting this here.

Bing is going crazy trying to index proxied pages from PHPRoxy. With Glype, it's easy to exclude browse.php in robots.txt. However, PHPRoxy doesn't use browse.php. It uses index.php. For example: /index.php?q=aHR0cDovL21pbmRjdHJs

I know it's possible to include user agents in .htaccess code. How can I use .htaccess to prevent Bing from crawling index.php?= (but without blocking index.php entirely) no matter what string comes after the = symbol?

Recommended Answers

user-agent: bingbot
disallow: index.php
Jump to Post

All 3 Replies

user-agent: bingbot
disallow: index.php

I see what you're getting at. robots.txt can probably accomplish the task. If this forum had a 'Thanks' button I'd use it.

You can upvote posts, should you want to, using the arrows next to the post.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of 1.20 million developers, IT pros, digital marketers, and technology enthusiasts learning and sharing knowledge.