Buy commercial curl support from WolfSSL. We help you work
out your issues, debug your libcurl applications, use the API, port to new
platforms, add new features and more. With a team lead by the curl founder
himself.
Resuming parallel downloads doesn't seem to work
- Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]
From: Jared Fowkes via curl-users <curl-users_at_lists.haxx.se>
Date: Wed, 6 Apr 2022 12:32:13 -0500
I'm attempting to download about 20 large files (>5GB) from a server that
is limiting me to less than 2MB/s and fewer than 9 concurrent connections.
To make matters worse, the connection keeps dropping out.
My current setup looks like:
curl -o {filename} {URL} -o {filename} {URL} -o {filename} {URL} -H
{Headers} -Z --parallel-max 7 --retry 9999 --retry-connrefused --compressed
--keepalive-time 20 -C -
I have also tried moving "-C -" before {URL}, but nothing changed. Curl
appears to resume the download, but the output file size remains the same.
I have not allowed it to complete, but assume that it would eventually
download the entire file over again.
Date: Wed, 6 Apr 2022 12:32:13 -0500
I'm attempting to download about 20 large files (>5GB) from a server that
is limiting me to less than 2MB/s and fewer than 9 concurrent connections.
To make matters worse, the connection keeps dropping out.
My current setup looks like:
curl -o {filename} {URL} -o {filename} {URL} -o {filename} {URL} -H
{Headers} -Z --parallel-max 7 --retry 9999 --retry-connrefused --compressed
--keepalive-time 20 -C -
I have also tried moving "-C -" before {URL}, but nothing changed. Curl
appears to resume the download, but the output file size remains the same.
I have not allowed it to complete, but assume that it would eventually
download the entire file over again.
-- Unsubscribe: https://lists.haxx.se/listinfo/curl-users Etiquette: https://curl.haxx.se/mail/etiquette.htmlReceived on 2022-04-06