cURL / Mailing Lists / curl-library / Single Mail

curl-library

Re: ftp serial transfers slow ... parallel fast

From: Joe Halpin <j.p.h_at_comcast.net>
Date: Wed, 10 Mar 2004 18:47:22 -0600

farr_at_metservice.com wrote:
> I am using the multi interface of libcurl 7.11.0 in a visual .net 2003
> project.
>
> When I try to transfer (ftp put or ftp get) large numbers of files from
> a windows box it goes really slowly. 293 files with median size of 5k
> and totalling 1Mbyte takes about 60 seconds through ftp. The same files
> take about 5 seconds to transfer when I copy them to the same box with
> smb (so there cant be any problem with the network connection ...
> right?). I can also drastically reduce the time it takes to transfer,
> by transfering many of them in parallel. Transferring the files with
> windows ftp client also seems to go very slowly. A very similar
> application on linux seems to go much faster but havn't actually tested
> to see how much. I am using pure-ftpd and ncftpd ftp daemons, and I
> have tried stuffing around with the configuration to get it to go
> faster, but have not had any luck.
>
> The obvious question is, how do I make it go faster without transferring
> everything in parallel? If not already implicit in the answer to the
> previous question, why would it seem slow from windows (perhaps I am
> just imagining things ...) ?

What are the settings for MTU, MSS and window size on all the boxes
concerned? If one of them has too low a setting for one or all of those
that could slow things down.

Running a sniffer like tcpdump while the slow transfer is going on would
help clarify the situation.

Joe
Received on 2004-03-11