Hi
I would like to create a crawler using java with mySQL as backend. It must work in such a way that it will crawl to a site and grab the data from that site. And then store that data in the database.
So can anybody tell me a way to start this project and how to go forward.
Thanks,
Kate
kateblossom
0
Newbie Poster
Recommended Answers
Jump to PostWell, the first place to start would be here at the tutorial on networking: http://java.sun.com/docs/books/tutorial/networking/index.html
As a basic outline, you would need to maintain a collection of URLs to visit, connect to …
All 3 Replies
Ezzaral
2,714
Posting Sage
Team Colleague
Featured Poster
Ezzaral
2,714
Posting Sage
Team Colleague
Featured Poster
sciwizeh
62
Posting Pro in Training
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.