cURL / Mailing Lists / curl-users / Single Mail

curl-users

RE: very slow sftp download speed

From: Michael Zhang <mxz9102_at_hotmail.com>
Date: Tue, 29 Apr 2014 17:49:26 -0700

Thanks a lot. Daniel,
I started to check out libcurl source code from git and tried to build it today. I saw the following paragraph in BUILD.WINDOWS.txt but am not able to get files from http://pecl2.php.net/downloads/php-windows-builds/.It seems this website has been down for a while. Do you know any mirror web site hosting these lib files?
  WITH_DEVEL=<path> - Paths for the development files (SSL, zlib, etc.) Defaults to sibbling directory deps: ../deps Libraries can be fetched at http://pecl2.php.net/downloads/php-windows-builds/

Michael Zhang
> Date: Thu, 24 Apr 2014 18:50:07 +0200
> From: dan_at_coneharvesters.com
> To: curl-users_at_cool.haxx.se
> Subject: Re: very slow sftp download speed
>
> On Thu, Apr 24, 2014 at 09:15:37AM -0700, Michael Zhang wrote:
> > Thank you very much for your explanation. Can the buffer size in
> > libcurl be changed by any settings externally? If not, Can I try to
> > modify this buffer size in libcurl source code and recompile it to
> > get a new version of libcurl?
>
> You should be able to configure libcurl with something like
> CPPFLAGS=-DCURL_MAX_WRITE_SIZE=4194304 to have it use a 4 MiB buffer.
> That should be enough to improve things.
>
> > On the top of libcurl, there is one more level- libssh2. Does it also
> > have any buffer size issue?
>
> No, recent versions have greatly improved the internals so it's now
> competitive with other ssh clients when used correctly.
>
> > 50% of speed loss will be acceptable if sftp is compared to ftp. We
> > really need to improve sftp download speed to make it w
>
> There was a thread in the libssh2 mailing list with some performance figures
> when the improvements were made a year or two ago. libssh2 should no longer
> be a bottleneck. I don't recall if anything was published for libcurl with
> a newer libssh2 and a larger buffer size.
>
> >>> Dan
> -------------------------------------------------------------------
> List admin: http://cool.haxx.se/list/listinfo/curl-users
> FAQ: http://curl.haxx.se/docs/faq.html
> Etiquette: http://curl.haxx.se/mail/etiquette.html
                                               

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ: http://curl.haxx.se/docs/faq.html
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2014-04-30