I am writing a console program and need to download 10K URLs. I asked this
question here
<http://stackoverflow.com/questions/26318017/how-to-run-only-n-thread-at-time-of-curl-in-bash>
in
stack overflow.

I just realize I can write files in any way I want. So, I can write a bash
script with all curl command. And because I want create N threads, I can
write N bash script files with 10K/N lines and open the N files at same
time in background.

Is this the easy and best strategy to speed up the downloads?

There isn't a program/command or anything that I input with a list of URL
with the path to save and it will download in N threads as fast as my
computer can do it?

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ: http://curl.haxx.se/docs/faq.html
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2014-10-11