Problem turned out to be with libcurl's default Expect: 100-continue http
header. Removing it sped up the transfers.

On Thu, Oct 8, 2015 at 12:57 PM, Sanchay Harneja <sanchay.h_at_gmail.com>
wrote:

> Actually you are right - I built a new libcurl with 4MB, but it didn't
> make any difference. I'll have to dig deeper. Thanks for the response!
>
> On Thu, Oct 8, 2015 at 12:03 PM, Daniel Stenberg <daniel_at_haxx.se> wrote:
>
>> On Thu, 8 Oct 2015, Sanchay Harneja wrote:
>>
>> We're using libcurl internally with guaranteed high bandwidth
>>> connections. Is there a way to increase CURL_MAX_WRITE_SIZE to speed up
>>> data transfers?
>>>
>>
>> Are you saying you're seeing a big increase in transfer speeds by doing
>> that? If so, I would like to get informed by some numbers.
>>
>> If you're only asking how to increase it: it is (still) a build-time
>> constant so you define it to something larger than 16K when you build
>> libcurl.
>>
>> It was set to 16K once after some basic testing when no real differences
>> could be seen with slightly larger buffers. For years we've discussed
>> introducing some sort of dynamic scheme that would allow it to get larger
>> when requested and especially for certain protocols.
>>
>> --
>>
>> / daniel.haxx.se
>> -------------------------------------------------------------------
>> List admin: http://cool.haxx.se/list/listinfo/curl-library
>> Etiquette: http://curl.haxx.se/mail/etiquette.html
>
>
>

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-library
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2015-10-10