I would like to create a crawler using java with mySQL as backend. It must work in such a way that it will crawl to a site and grab the data from that site. And then store that data in the database.
So can anybody tell me a way to start this project and how to go forward.
Jump to Post
Well, the first place to start would be here at the tutorial on networking: http://java.sun.com/docs/books/tutorial/networking/index.html
As a basic outline, you would need to maintain a collection of URLs to visit, connect to …
All 3 Replies
We're a friendly, industry-focused community of 1.20 million developers, IT pros, digital marketers, and technology enthusiasts learning and sharing knowledge.