Buy commercial curl support from WolfSSL. We help you work
out your issues, debug your libcurl applications, use the API, port to new
platforms, add new features and more. With a team lead by the curl founder
himself.
Re: Can Curl round-robin IP addresses for successive connects?
- Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]
From: Rainer Canavan via curl-library <curl-library_at_cool.haxx.se>
Date: Thu, 1 Oct 2020 19:09:14 +0200
On Thu, Oct 1, 2020 at 6:36 PM Jason Proctor via curl-library
<curl-library_at_cool.haxx.se> wrote:
>
> Dear Curl,
>
> Our application pulls resources from CloudFront and we noticed some
> significant bandwidth capping. Turns out that for maximum throughput,
> Amazon recommend requests be spread across the IP addresses returned
> by the DNS call.
>
> However from looking at Curl_connecthost() and related functions, it
> seems that Curl only round-robins through cached addresses when there
> is a connect error.
I think you should set up one curl handle for each address using CURLOPT_RESOLVE
and then re-use the handles round-robin, so that you can benefit from
connection
re-use on TCP-connections that are already warmed up, as well as parallelism to
multiple servers.
Rainer
-------------------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-library
Etiquette: https://curl.haxx.se/mail/etiquette.html
Received on 2020-10-01
Date: Thu, 1 Oct 2020 19:09:14 +0200
On Thu, Oct 1, 2020 at 6:36 PM Jason Proctor via curl-library
<curl-library_at_cool.haxx.se> wrote:
>
> Dear Curl,
>
> Our application pulls resources from CloudFront and we noticed some
> significant bandwidth capping. Turns out that for maximum throughput,
> Amazon recommend requests be spread across the IP addresses returned
> by the DNS call.
>
> However from looking at Curl_connecthost() and related functions, it
> seems that Curl only round-robins through cached addresses when there
> is a connect error.
I think you should set up one curl handle for each address using CURLOPT_RESOLVE
and then re-use the handles round-robin, so that you can benefit from
connection
re-use on TCP-connections that are already warmed up, as well as parallelism to
multiple servers.
Rainer
-------------------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-library
Etiquette: https://curl.haxx.se/mail/etiquette.html
Received on 2020-10-01