Open Source Webcrawler?

Expand Post »

I'm looking for an open source webcrawler which can be easily modified. Is anyone aware of a good open source crawler? I'm just enrolled in a dataminning course and would like to develop an algorithm which categorizes web pages. I need to be able to control which pages are indexed and how those pages are categorized, both based on the page content. Thanks.

Similar Threads

Looking for open source message queue implementation in Java
Open Source Projects in C++
Looking for open source gateway in Java
The Eternal Sun - open-source MMORPG needs coders in C++

SkyRenderX

Reputation Points: 10

Solved Threads: 0

Newbie Poster

Offline

1 posts
since Oct 2007

This thread is more than three months old

No one has posted to this discussion for at least three months. Please let old threads die and do not reply to them unless you feel you have something new and valuable to contribute that absolutely must be added to make the discussion complete. Otherwise, please start a new thread in this forum instead.

Previous Thread in Configuring Readymade Scripts Forum Timeline: Script for deleting Enteries in registry

Next Thread in Configuring Readymade Scripts Forum Timeline: Need help with changing the index.php file

DaniWeb Message

Cancel Changes

User Name
Password