Member Avatar
I want to disallow certain query strings with robots.txt and I want to check I am doing this correctly... I am using: ... I want to check that this rule will allow these urls to be indexed: browse.asp?cat=123/1234/1234-1 browse.asp?cat=123/1234-1 While disallowing these urls: browse.asp?cat=1234-1 browse.asp?cat=1234-2 Will this rule work? or …
by NuGG 15 in UI / UX Design ()
Member Avatar
Hifriends! I've just started working on SEO for my sites, but I have problems in my first attempt. I signed int to Google Webmaster tools...added a site and verified it successfully. My site even started appearing on Google Search and within a very short time, it was on the first …
by savedlema 17 in Search Engine Strategies ()
Member Avatar
Hi, I am going to submit a new website in Google (deveoped in PHP) today. I have 'include' folder which has header.php, footer.php and navigation.php files. I have included them in each web page of my site using <?php include ('./includes/header.php'); ?>. I do not want these php files to …
by tarwara in Search Engine Strategies ()
Member Avatar
We have the valid URLs: If I want to disallow them all in robots.txt, are both of these valid and will they do the same thing? Will the latter also block the URL www.daniweb.com/foo or will that be interpreted as a page underneath the root directory, and not within the …
by Dani 1,404 in Linux and Unix ()
Member Avatar
My URL is: and for robots: Hello, When I started, I only submitted one site to Google (which went fine). Then I tried adding more pages, and it would not go through. I have added a phpbb script, tried editing it, to no avail. I tired messing around with eiliminating …
by vivosmith 27 in UI / UX Design ()
Member Avatar
I would like to know that which things of website, an expert SEO must put into robots.txt file for disallow? Which pages is better to not show to Search Engines?
by jesicawillss -16 in Search Engine Strategies ()
Member Avatar
I have created a sub domain and put robots file As follows User-agent: * DisAllow: / Will it affect my main domain? I have robots file in my main domain as follows User-agent: * Allow: /
by webmaster@123 in Search Engine Strategies ()
Member Avatar
I have page1.html that is being 302 redirected (temporary redirect) to page2.html page2.html is disallowed in my robots.txt file Under normal circumstances, when googlebot encounters a 301 redirect from page1.html to page2.html, it will index page2.html, and when googlebot encounters a 302 redirect from page1.html to page2.html, it will index …
by Dani 1,404 in Search Engine Strategies ()
Member Avatar
I want to report deadlinks on my site, my current script does work but it allows search engine bots to click the dead link report which makes it hard for me to determine which reports are form visitors and which are from bots. What am I doing wrong here? As …
by Blitz-labs.com in Web Development ()