cURL / Mailing Lists / curl-users / Single Mail


The fastest way to download a list of URL

From: Rodrigo Zanatta Silva <>
Date: Sat, 11 Oct 2014 17:38:35 -0300

I am writing a console program and need to download 10K URLs. I asked this
question here
stack overflow.

I just realize I can write files in any way I want. So, I can write a bash
script with all curl command. And because I want create N threads, I can
write N bash script files with 10K/N lines and open the N files at same
time in background.

Is this the easy and best strategy to speed up the downloads?

There isn't a program/command or anything that I input with a list of URL
with the path to save and it will download in N threads as fast as my
computer can do it?

List admin:
Received on 2014-10-11