954,089 Members — Technology Publication meets Social Media
Username:
Password:
Lost login information?
Have something to say? Contribute New Article Reply to this Article

Web Site Scraping

Hello
Does anyone know of some good Web Site Scraping software that they can reccomend
Thanks

mairtin.obrian
Newbie Poster
9 posts since Oct 2006
Reputation Points: 10
Solved Threads: 0
 

I don't know a thing about it, but did you check google ?

Ancient Dragon
Retired & Loving It
Team Colleague
30,040 posts since Aug 2005
Reputation Points: 5,662
Solved Threads: 2,341
 
Hello Does anyone know of some good Web Site Scraping software that they can reccomend Thanks

I am a marketing consultant for a company that was trying to scrape several sites to get their pricing competitive with everyone else online. I spent a good month learning the programs out there and using them until I found one that actually worked. Not only did it work it blew me way. These guys have a great vision making the system open enough to have the data harvested and then sent back to the user via REST, FTP, or email. The client loves me as the closest competitor was $50,000/year and they did not work as well. Anyway try mozenda.com for your web scraper I think you will be very happy. I wish I had read this before spending so much time trying the other ones.

In full disclosure I have to say that I Invested in this company (Mozenda Inc.) after trying their tool.

Hope this helps,
Jon

jthralow
Newbie Poster
2 posts since Jun 2009
Reputation Points: 10
Solved Threads: 0
 

I use Djuggler for web scraping. Works perfectly for me so far, including sites that use AJAX. Best of all you can compile the scrape scripts as standalone executables.

R.

RonVelder
Newbie Poster
1 post since Jul 2009
Reputation Points: 10
Solved Threads: 0
 

This article has been dead for over three months

Post: Markdown Syntax: Formatting Help
You
View similar articles that have also been tagged: