I've made a web-crawler in VB6. I'd like to port it to .NET so I can make it accesible to the public over the web.

Basically my own version of Poodle.

Porting most of the code will be very easy, BUT, I haven't found any way via .NET to read a file 'text,html,etc..' over the web on another server.

Is this possible?


You cannot direclty read a file on another server. You can browser to it, though. What you need to do is called "screen scraping", I think. You might start a thread or do some Google searches on that topic.

Found a component AspTear ( works great )


Hmmm.. Looks like ASP.net has a built in component for scrapping pages.

Anyone interested...

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.