954,549 Members — Technology Publication meets Social Media
Username:
Password:
Lost login information?
Have something to say? Contribute New Article Reply to this Article

making a bot... help please

Ok! Hello Daniwebbers, lets see if you can help me this time:

I'm planning to do a bot, to login into a site, collect some data and then send a report to me.

Problem is, I've done some web-scrapping data before, but I have no idea on how to do to keep sessions alive from one request to other, what I want to do is the following:

1) login ( www.somewebsite.com/login )
2) collect data ( www.somewebsite.com/hit_stats )

does the httpsession have something to do with this?

please give me some ideas :) I need a start point.

Thanks

RicardoE
Junior Poster in Training
73 posts since Jan 2010
Reputation Points: 21
Solved Threads: 7
 

Start with the URLConnection classes.

NormR1
Posting Expert
Moderator
6,677 posts since Jun 2010
Reputation Points: 1,138
Solved Threads: 656
 

thanks!

I used Selenium Server standalone, it works like a charm

RicardoE
Junior Poster in Training
73 posts since Jan 2010
Reputation Points: 21
Solved Threads: 7
 

This article has been dead for over three months

Post: Markdown Syntax: Formatting Help
You
View similar articles that have also been tagged: