On Fri, 12 Apr 2013, Giuseppe Attardi wrote:

> I found the cause of the truncated files. It is due to libcurl aborting some
> transfers because of reaching the low speed limit.

> I am using a fast 1Gb Internet connection and monitoring the bandwidth usage
> shows that I am well below saturation.

And all connections are to servers with the same fast connection and there's
no bottlenecks anywhere?

> Could it be due to other OS issues, like the number of connections becoming
> too large? I did increase though the limit on open files to 200000. The
> machine has 24 cores, 28 GB of memory and is largely idle.

It shouldn't reach any limits that I can think of. And if it did, you'd get
some good errors in the verbose logs not just slow transfers.

What resolver are you using? If you're using the default synchronous one, my
guess is that you sometimes get slow resolves that then kills connections
since they all stall during the resolve.

What if you remove the low speed limit, how do things run then?

-- 
  / daniel.haxx.se
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-library
Etiquette:  http://curl.haxx.se/mail/etiquette.html