cURL / Mailing Lists / curl-library / Single Mail

curl-library

Re: Poor HTTP POST upload performance

From: Bryan Christ <bryan.christ_at_gmail.com>
Date: Thu, 16 Apr 2015 12:00:44 -0500

We'll I'm writing a standalone app since that's what's being requested of
me. I probably won't finish until the end of the month since I have other
obligations to trend to. It's already several hundred lines of code and I
expect it might break a thousand before it's done. I'm sure it will prove
my suspicions and then I'll step up to the plate with a fix for the buffer.
On Apr 16, 2015 2:16 AM, "Dan Fandrich" <dan_at_coneharvesters.com> wrote:

> On Wed, Apr 15, 2015 at 08:41:16PM +0200, Daniel Stenberg wrote:
> > On Mon, 13 Apr 2015, Bryan Christ wrote:
> > >I've been trying to figure out why http POST uploads are so slow with
> > >libcurl. Upload speeds continually perform at about 1/10th of the
> > >expected performance (or less). Many users have reported this behavior
> on
> > >our forum. I suspect it has a lot to do with CURL_MAX_WRITE_SIZE being
> set
> > >to 16k.
> >
> > Why suspect? Rebuild a test version with it set to 1024KB and see what
> > difference it makes (if any) and remove any doubts.
> >
> > We have settled on the current size only because we have not seen any
> > evidence of a larger buffer giving any notable difference (in most cases
> -
> > not counting SFTP).
> >
> > We are always open to reevaluating our former decisions, but we prefer
> doing
> > so based on data and evidence to back up the ideas!
>
> A selectable buffer size is 1.6 in the TODO list, where it's been for a
> very
> long time now. It wouldn't be that difficult a change, it's just that
> no-one
> has ever stepped up with a patch.
>
> >>> Dan
> -------------------------------------------------------------------
> List admin: http://cool.haxx.se/list/listinfo/curl-library
> Etiquette: http://curl.haxx.se/mail/etiquette.html

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-library
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2015-04-16