6 Discussion / Question Topics
Remove Filter
|
|
|
|
is robot.txt files important? how do we remove it please? 
|
|
|
|
|
|
My website isn't getting crawled to my knowledge at all or very infrequently does my robots.txt file have something to do with that? My current file looks like User-agent: * Disallow: / Is this good or bad for crawls? 
|
|
I'm in a computer programming course on Florida Virtual School, and I'm stressing out over our current assignment, because it seems like it should be easy. The point of the assignment is to write a program to count how many times the Scribbler robot stalls and then print the results …
|
|
Looks like every single thread gets double tweeted immediately by one guy (in software development), see attached sample. 
|
|
|
I have created a search bar using PHP that pulls from my database by keywords typed in the search bar and displays links and descriptions of URLs' associated with the keywords. Is there a way for robots to randomly type keywords in my search bar on my website to list … 
|
The End.