Hey everyone, well i've been recently for the last day pondering on the idea of creating a web spider, but i just don't know where to start. What i think mainly the spider is built off of using the urllib, socket, and urllib2 modules to do the spiders bidding, i just don't know where to start. Thanks, Clipper34.
Clipper34
0
Newbie Poster
woooee
814
Nearly a Posting Maven
I once Googled for "python web crawler". There were many but this is the only one saved http://www-128.ibm.com/developerworks/linux/library/l-spider/ "See Example 4: Web site crawler"
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.