cURL / Mailing Lists / curl-library / Single Mail

curl-library

Re: Please advise on how to improve libcurl HTTP GET performance

From: Alan Wolfe <alan.wolfe_at_gmail.com>
Date: Tue, 11 Oct 2011 10:44:32 -0700

Hey Dan,

FYI he ran curl with --libcurl so that it created some source code to use
with libcurl to do the same request.

With that code unmodified and his libraries he built, he got the slow
transfer rate he saw before.

With the curl command line utility he gets about 10x as much speed.

On Tue, Oct 11, 2011 at 10:37 AM, Dan Fandrich <dan_at_coneharvesters.com>wrote:

> On Tue, Oct 11, 2011 at 08:39:36PM +0400, Alex wrote:
> > I've used the --libcurl option and compiled the resulting .cpp. Guess
> what?.. Same 35-40 KB/s, whereas Curl gives me ~300 KB/s.
> > I only see one explanation: there's something wrong about the way I have
> compiled libcurl.
>
> A more likely explanation is the way the application handles the data. A
> naive append() operation in the receive callback, for example, would turn
> a simple download into an O(n**2) operation. Try compiling one of the
> libcurl example apps against your libcurl and benchmark your libcurl that
> way.
>
> >>> Dan
> -------------------------------------------------------------------
> List admin: http://cool.haxx.se/list/listinfo/curl-library
> Etiquette: http://curl.haxx.se/mail/etiquette.html
>

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-library
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2011-10-11