Hi again.
I want to create a robot or spider or crawler with python urllib. Still couldn't find any good tutorial. Any suggestion?!

Recommended Answers

You could also take a look at Scrapy:
http://scrapy.org/
and
https://pypi.python.org/pypi/Scrapy

Jump to Post

All 3 Replies

check here www.udacity.com

The course project is about making a search engine and building a social network. There is a chapter about web crawlers and ranking web pages using Page Rank algoritm... There is a button 'Access Course Material' just below the 'Start a Free Trial' one and its free.

Thank you @Slyte, but unfortunatelly when i checked the link, i faced with error 403 :(

Be a part of the DaniWeb community

We're a friendly, industry-focused community of 1.19 million developers, IT pros, digital marketers, and technology enthusiasts learning and sharing knowledge.