Hello

I would like to make some kind of download manager that you can feed a file of links which it would then download.
I can make it work for one at a time but it takes like forever to do them all and my internet connection isn't fully used so I would like to make it download multiple things at the same time.
I know wget can't do this but maybe I can split the file up in parts and download for example 4 thing at the same time using 4 separate wget commands.
How can I do this (as simple as possible)

Thanks,

Jasper

Recommended Answers

All 2 Replies

#!/bin/sh

options=-q
file=$1

while IFS= read -r file
do
  wget $options "$file" &
done < "$file"

Have you tried the multithreaded command line downloader called aria2c.
It is at http://aria2.sourceforge.net/ and it is very good. I use it all the time. I was going to do the same thing as you, but stumbled on this instead. Fully scriptable.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.