Shell Scripting

Logging into to a site

Please support our Shell Scripting advertiser: Programming Forums - DaniWeb Sister Site

•

Join Date: May 2008

Posts: 42

Reputation: tondeuse34 is an unknown quantity at this point

Solved Threads: 2

tondeuse34 tondeuse34 is offline

Offline

Light Poster

Logging into to a site

Jan 24th, 2009

Hey guys, i'm having some trouble using wget. What i'm trying do is log into a site, once its logged is to go to a certain link. And once it is there download all the files on the page, but check back later to see if any new ones are there. So far i've made up this:

 Help with Code Tags 
 Shell Scripting Syntax (Toggle Plain Text) 
#!/bin/sh
 
start() [--user=USER --password=PASS -A .pdf,.doc -r -Nc http://google.com]
 
new() [$new_file = wget --user=USER --password=PASS -N -A.pdf,.doc -r -Nc http://www.google.com]
 
if [start()] then
echo Downloading files...
 
if [new()] then
echo Found new files!...Downloadi
#!/bin/sh

start() [--user=USER --password=PASS -A .pdf,.doc -r -Nc http://google.com]

new() [$new_file = wget --user=USER --password=PASS -N -A.pdf,.doc -r -Nc http://www.google.com]

if [start()] then
echo Downloading files...

if [new()] then
echo Found new files!...Downloadi

Whenever i attempt to use --user=USER and --password=PASS it does not log me in to the site i am using, that is my main obstacle right now. What do you guys suggest i do?, Thanks. Clipper34.

•

Join Date: Oct 2007

Posts: 399

Reputation: eggi will become famous soon enough

Solved Threads: 47

eggi

Offline

Posting Whiz

Re: Logging into to a site

Jan 24th, 2009

Hey There,

It might have to do with the user agent string that wget passes to the site (I think it's something like wget-version). You can manipulate the --user-agent= variable to pass anything, just be careful that you don't use Mozilla as they're litigation happy (more details on the options page on wget's site regarding getting sued by them)

That's just one possibility.

Hope it helps

, Mike

Linux and Unix Tips, Tricks and Individual Advice - The Linux and Unix Menagerie!
------------------------------------------------------------------------
The greatest viral marketing idea of all time, get your copy of this Free Report now!