Bugs item #3406307, was opened at 2011-09-08 08:11
Message generated for change (Settings changed) made by bagder
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=100976&aid=3406307&group_id=976

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: libcurl
Group: bad behaviour
>Status: Closed
Resolution: Works For Me
Priority: 5
Private: No
Submitted By: Christine Miyachi (cmiyachi)
Assigned to: Daniel Stenberg (bagder)
Summary: libcurl select/poll returned error when xfer'ing large files

Initial Comment:
When transferring many large files in a row (~175 MB), libcurl will fail on the 4 file repeatedly with this error. We are on Linux and we spawn a thread for each transfer.

This appears to be a somewhat common problem if you google the header of this bug.

----------------------------------------------------------------------

Comment By: Daniel Stenberg (bagder)
Date: 2011-09-16 14:08

Message:
curl_global_init() is not thread-safe, but you shouldn't need to use that
more than once very early on.

So can you produce an example program that repeats the problem so that we
can investigate?

----------------------------------------------------------------------

Comment By: Christine Miyachi (cmiyachi)
Date: 2011-09-14 17:53

Message:
I meant to say the 4th file.

We are now using mutexes so that only one file transfers at a time. Is
that really necessary?

Are the curl init functions thread safe? I know thay say they are NOT in
the docs but thought I would ask anyway because in other places on the web
I read that they are and that libcurl in general is thread safe.

We still get errors like:

   WARN>> write_for_libcurl Unexpected return of 0 from fwrite (expected
5089)
  ERROR>> Curl error: Failed writing body (0 != 5089)

And

Curl error: couldn't connect to host

But we are testing the application hard with 200 MB transfer requests 10 in
a row fast.

I'm thinking we are reaching the limits to our system?

----------------------------------------------------------------------

Comment By: Daniel Stenberg (bagder)
Date: 2011-09-13 09:55

Message:
Thanks for reporting this issue and helping us improve curl and libcurl.

We're awaiting feedback in this issue. Due to this, I have set the state of
this issue to pending and it will automatically get closed later on unless
we get further info.

Please consider answering the outstanding questions or providing the
missing info so that we can proceed to resolve this issue!

----------------------------------------------------------------------

Comment By: Daniel Stenberg (bagder)
Date: 2011-09-08 11:25

Message:
Please provide a sample program that repeats this bug. I'll admit I don't
understand the description and can't do anything about it without lots of
more details or ways to repeat it.

"will fail on the 4 file" - what does that mean?

----------------------------------------------------------------------

You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=100976&aid=3406307&group_id=976
Received on 2012-02-23