cURL / Mailing Lists / curl-library / Single Mail

curl-library

Re: maximizing performance when issuing a large number of GET/PUT requests to a single server

From: Alex Loukissas <alex_at_maginatics.com>
Date: Thu, 11 Aug 2011 14:22:01 -0700

On Thu, Aug 11, 2011 at 2:07 PM, Daniel Stenberg <daniel_at_haxx.se> wrote:
> On Thu, 11 Aug 2011, Alex Loukissas wrote:
>
>>> The multi interface does all the transfers you add to it in parallell.
>>
>> So does it do it in a multi-threaded fashion (probably not, since I didn't
>> have to compile/link against a threading library)? I was under the
>> impression that that's not the case. Or by parallel you mean it opens
>> simultaneous ports and interleaves them?
>
> It does multiple parallell transfers using a single thread, yes. It opens
> has many connections as required to perform all the transfers you tell it to
> do and then it makes them all fly. And then you get to know when they finish
> and you can add new transfers or remove existing ones along the way when you
> think is a good time.
>

Great, thanks for your clarification and your help here. I'll let you
know which avenue worked best.

> --
>
>  / daniel.haxx.se
> -------------------------------------------------------------------
> List admin: http://cool.haxx.se/list/listinfo/curl-library
> Etiquette:  http://curl.haxx.se/mail/etiquette.html
>

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-library
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2011-08-11