943,800 Members | Top Members by Rank

Internet Marketing > Search Engine Optimization > It has been over 45 days since googlebot visited my site, what shoudl I do?
Ad:
You are currently viewing page 1 of this multi-page discussion thread
Permalink
Apr 27th, 2006
0

It has been over 45 days since googlebot visited my site, what shoudl I do?

Expand Post »
Hi everyone, this website stuff is all new to me. So I have set up my web site, read through all tutorials and how to's.
Created my keywords, meta tags , description & etc..
Created my sitemap.xml (using Google's Python tool) along with urllist.txt & config.xml and created my robots.txt
Now when I use Google Sitemap tool , I see that Google is working with some cached data , from March 12 and none of the keywords and tags that I have added in the last few weeks have been indexed.
I keep submitting my sitemap to google, however that does not seem to change anything
Can some please give me a clue on what else I need to do.

Thanks in advance

Jay
Reputation Points: 10
Solved Threads: 0
Newbie Poster
jaytaba is offline Offline
3 posts
since Apr 2006
Permalink
Apr 27th, 2006
0

Re: It has been over 45 days since googlebot visited my site, what shoudl I do?

Hi Jay,

Welcome to Daniweb. Great post!

What you need to do is build links. Googebot (and the others) finds your site by crawling new links. There are many quality resources for link building here on Daniweb. What I would suggest is to list your site in a few directories (such as Yahoo, Best of the Web) which will cost a few bucks and take a few days. Alternatively you can purchase text link ads. I don't want to go into all the different ways of acquiring links, but a directory listing should be all it takes to get included.
Reputation Points: 11
Solved Threads: 1
Posting Whiz in Training
jewboy is offline Offline
252 posts
since Feb 2005
Permalink
Apr 29th, 2006
0

Re: It has been over 45 days since googlebot visited my site, what shoudl I do?

Swap links Get your site visible to spiders crawling other sites and finding yours. A big misconception is that a Google sitemap will let Google find your site and know about your pages. Simply not true! The only way to get Google to spider your site is by building pagerank through incoming links (known as backlinks). The higher your pagerank, the more frequently googlebot will return to your site and the more pages it will spider at a time. If you find that google isn't spidering your most important pages, a sitemap will lend them a helping hand by allowing you to specify what pages you give a higher priority to. But, remember, you need backlinks to build pagerank, and pagerank dictates how many pages they'll spider ... a sitemap will just let you tell googlebot which of your pages are more important and should get first dibbs at the googlebot.
Administrator
Staff Writer
Reputation Points: 1422
Solved Threads: 162
The Queen of DaniWeb
cscgal is offline Offline
13,645 posts
since Feb 2002
Permalink
Jun 20th, 2006
0

Re: It has been over 45 days since googlebot visited my site, what shoudl I do?

He could also check if his domain is banned in Google. Google Banned Tool is good for new sites that could be banned
Last edited by palconit; Jun 20th, 2006 at 1:10 pm.
Reputation Points: 10
Solved Threads: 0
Newbie Poster
palconit is offline Offline
6 posts
since Jun 2006
Permalink
Jun 23rd, 2006
0

Re: It has been over 45 days since googlebot visited my site, what shoudl I do?

Thanks for the tidbit. Not familiar with that
Administrator
Staff Writer
Reputation Points: 1422
Solved Threads: 162
The Queen of DaniWeb
cscgal is offline Offline
13,645 posts
since Feb 2002
Permalink
Jul 12th, 2006
0

Re: It has been over 45 days since googlebot visited my site, what shoudl I do?

Quote originally posted by jaytaba ...
Hi everyone, this website stuff is all new to me. So I have set up my web site, read through all tutorials and how to's.
Created my keywords, meta tags , description & etc..
Created my sitemap.xml (using Google's Python tool) along with urllist.txt & config.xml and created my robots.txt
Now when I use Google Sitemap tool , I see that Google is working with some cached data , from March 12 and none of the keywords and tags that I have added in the last few weeks have been indexed.
I keep submitting my sitemap to google, however that does not seem to change anything
Can some please give me a clue on what else I need to do.

Thanks in advance

Jay
Hi,

Very simple
Add quality and related one-way links with good PR. You will be in the top
Reputation Points: 10
Solved Threads: 0
Junior Poster in Training
newonlineinfo is offline Offline
96 posts
since Jul 2006
Permalink
Jul 13th, 2006
0

Re: It has been over 45 days since googlebot visited my site, what shoudl I do?

Quote originally posted by jaytaba ...
Hi everyone, this website stuff is all new to me. So I have set up my web site, read through all tutorials and how to's.
Created my keywords, meta tags , description & etc..
Created my sitemap.xml (using Google's Python tool) along with urllist.txt & config.xml and created my robots.txt
Now when I use Google Sitemap tool , I see that Google is working with some cached data , from March 12 and none of the keywords and tags that I have added in the last few weeks have been indexed.
I keep submitting my sitemap to google, however that does not seem to change anything
Can some please give me a clue on what else I need to do.

Thanks in advance

Jay
Just no need to care when google index your pages or not. Site map is also not a right key. Just focus on your quality contents, quality links then Google will like it and do the rest.
Good luck.
Reputation Points: 10
Solved Threads: 0
Junior Poster in Training
Spiderweb is offline Offline
72 posts
since Mar 2006
Permalink
Jul 25th, 2006
0

Re: It has been over 45 days since googlebot visited my site, what shoudl I do?

Googlebot has two versions, deepbot and freshbot. Deepbot is a deep crawler that tries to folow every link on the web and download as many pages as it can for the Google index. It also examines the internal structure of a site, giving a complete picture for the index.
Freshbot, on the other hand, is a newer bot that crawls the web looking for fresh content. The Google freshbot was implemented to take some of the pressure off of the GoogleBot. The freshbot recalls pages already in the index and then crawls them for new, modified, or updated pages. In this way, Google is better equipped to keep up with the ever-changing Web.
This means that the more you update your web site with new, quality content, the more the Googlebot will come by to chëck you out. If you'd like to see the Googlebot crawling around your web property more often, you need to obtain quality inbound links. However, there is also one more step that you should take. If you haven't already done so, you should create a Google Sitemap for your site.
Creating a Google sitemap allows you to communicate with Google, telling them about your most important pages, new pages, and updated pages. In return, Google will provide you with some valuable information as well. Google Sitemaps will tell you about pages it was unable to crawl and links it was unable to follow. This allows you to pinpoint problems and fix them so that you can gain increased exposure in the search results.
I hope this one will help you.
Reputation Points: 10
Solved Threads: 0
Newbie Poster
born2win is offline Offline
12 posts
since Jun 2006
Permalink
Jul 26th, 2006
0

Re: It has been over 45 days since googlebot visited my site, what shoudl I do?

Quote originally posted by jaytaba ...
Hi everyone, this website stuff is all new to me. So I have set up my web site, read through all tutorials and how to's.
Created my keywords, meta tags , description & etc..
Created my sitemap.xml (using Google's Python tool) along with urllist.txt & config.xml and created my robots.txt
Now when I use Google Sitemap tool , I see that Google is working with some cached data , from March 12 and none of the keywords and tags that I have added in the last few weeks have been indexed.
I keep submitting my sitemap to google, however that does not seem to change anything
Can some please give me a clue on what else I need to do.

Thanks in advance

Jay
Jay, you need links and one quick way to get them is to make a link to your site in your signature in forums. Don't ask me how I know, it just came to me... :-)

BB
Reputation Points: 10
Solved Threads: 0
Newbie Poster
Big Bill is offline Offline
9 posts
since Jul 2006
Permalink
Jul 26th, 2006
0

Re: It has been over 45 days since googlebot visited my site, what shoudl I do?

Quote originally posted by born2win ...
Googlebot has two versions, deepbot and freshbot. Deepbot is a deep crawler that tries to folow every link on the web and download as many pages as it can for the Google index. It also examines the internal structure of a site, giving a complete picture for the index.
Freshbot, on the other hand, is a newer bot that crawls the web looking for fresh content. The Google freshbot was implemented to take some of the pressure off of the GoogleBot. The freshbot recalls pages already in the index and then crawls them for new, modified, or updated pages. In this way, Google is better equipped to keep up with the ever-changing Web.
This means that the more you update your web site with new, quality content, the more the Googlebot will come by to chëck you out. If you'd like to see the Googlebot crawling around your web property more often, you need to obtain quality inbound links. However, there is also one more step that you should take. If you haven't already done so, you should create a Google Sitemap for your site.
Creating a Google sitemap allows you to communicate with Google, telling them about your most important pages, new pages, and updated pages. In return, Google will provide you with some valuable information as well. Google Sitemaps will tell you about pages it was unable to crawl and links it was unable to follow. This allows you to pinpoint problems and fix them so that you can gain increased exposure in the search results.
I hope this one will help you.
I had to leave that all in so I could point at each bit of it individually, sorry for duping and bandwidth and everything. used to have two bots, true, now has a couple more actually, I believe, essentially mediabots but, but but but, lately the game's changed, you need a goodly measure of inbound links before you become worth spidering and indexing and checking, so you can add fresh content till the cows come home and it won't do you a scrap of good unless you have Google's version of provenance which usually means loads of quality inbound links. And he does have a sitemap, he built in in Python, yet! Dood knows more than I do... :-(

BB
Reputation Points: 10
Solved Threads: 0
Newbie Poster
Big Bill is offline Offline
9 posts
since Jul 2006

This thread is more than three months old

No one has posted to this discussion for at least three months. Please let old threads die and do not reply to them unless you feel you have something new and valuable to contribute that absolutely must be added to make the discussion complete. Otherwise, please start a new thread in this forum instead.
Message:
Previous Thread in Search Engine Optimization Forum Timeline: Sitemap in robots.txt
Next Thread in Search Engine Optimization Forum Timeline: public stats





About Us | Contact Us | Advertise | Acceptable Use Policy
Forum Index | Build Custom RSS Feed


Follow us on Twitter


© 2011 DaniWeb® LLC