Hi,
I am trying to understand & code web crawling. I want to crawl only my local data[Pages related to a particular site]. Apart from that i want to fetch only particular data from the related web page. I also have to store the fetched data in a mysql database. JSP is a preferable language because I am comfortable programming in it.
I have tried reading some of the tutorials, tried using Google local search etc. But am confused and not getting a clear picture of what can be done or what I should refer to.
Any pointers will be of great help.
Thanks for your time.