[scraper] Forum Topics

Hi, I am looking to write a internet scraper, and have considered the following languages: Python C++ Java The scraper will need to: - Retrieve HTML code from a page - Select a link, name and description from a section of the page - Ask for user confirmation (non gui …

Hello, I am trying to navigate through all the pages(links) in the following HTML code : <div class="ajax_paginator"> <ul> <li class="prev"><a href="#">«</a></li> <li class="p1 current"><a href="#">1</a></li> <li class="p2"><a href="#">2</a></li> <li class="p3"><a href="#">3</a></li> <li class="p4"><a href="#">4</a></li> <li><span>…</span></li> <li class="p944"><a href="#">944</a></li> <li class="next"><a href="#">»</a></li> </ul> </div> I am using Webbrowser control(C#) to …

Hi, I have to use Java to build a scrapper, that takes a product name and searches for that product on an e-commerce website. I understand that I will have to use an external library that would parse the html page for me, given the link. But how do I …