hi again i have been assigned a project to create a web crawler in python but i have no idea where to start so all help will be welcome.
leegeorg07
Recommended Answers
Jump to PostThis is a good place to start. http://cis.poly.edu/cs912/parsing.txt
That is sample code that you can use to gather all of the links on a particular web page. Once you have the list of links on a page, you could repeat the process for each one of …
Jump to Postif you add a line
print(item)
before your linedata = urllib.urlopen(item)
you might see why urlopen can't open the url.
All 5 Replies
mn_kthompson
3
Junior Poster
leegeorg07
Gribouillis
1,391
Programming Explorer
Team Colleague
leegeorg07
leegeorg07
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.