cURL / Mailing Lists / curl-library / Single Mail

curl-library

Re: 5 uploads per second

From: Daniel Stenberg <daniel_at_haxx.se>
Date: Sun, 7 Sep 2003 16:14:19 +0200 (CEST)

On Fri, 5 Sep 2003, Peter Stirzel wrote:

> I want to upload a list of files from a queue to one destination (one
> address, user, pwd). Under full load conditions approx. 20 files per second
> are written to the queue (file size < 1kByte)
>
> I am using libcurl to upload this files and my target is to reach 20
> uploads/second.
>
> Right now I "only" achieve 5 uploads/second with easy_ or multi_perform.
>
> Do I have a chance to get the required upload rate without using pthreads?

It depends on how you use libcurl at the moment. If you are re-using the same
easy handle for all transfers and your code is not wasting any time between
the single transfers, then I can't figure out any way. You'd then be at
maximum speed. I know some people in certain conditions tweak the TCP options
(for example disabling the Nagle algorithm), but libcurl has no interface that
allos anything like that.

But, if you are at maximum speed already using a sinle thread, it isn't
certain that you can get much higher speeds by using pthreads, as what delays
your operation here is not slow code, but slow network operations.

That's my view of things anyway!

-- 
 Daniel Stenberg -- curl: been grokking URLs since 1998
-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
Received on 2003-09-07