Hi,

I just debug the curl API to identify the root cause of my problem and
found that the following line is giving problem

in curl_read() // sendf.c file

nread = conn->recv[num](conn, num, buffertofill, bytesfromsocket,
&curlcode);

the return value is '0' so k->keepon value become zero and the *done
becomes true. So the while loop in Transfer() // transfer.c comes out.

I further analyzed the code and found that ' nread; value set by sread() in
Curl_recv_plain() //sendf.c

I then added a while loop to retrieve the recv() for 5 times.. but no luck
i didnt get any debug prints and positive sign..

Can you please tell me how to rectify this error.. ? Im really struggling a
lot because of this errror.

Thanks in advance

Regards,
Ilavarasan M.

On Sat, Jan 5, 2013 at 4:37 PM, ilavarasan M <m.ilavarasan_at_gmail.com> wrote:

> Hi,
> Thanks Alan & alpforce for confirming the issue. Let me check my side
> whether I can do like you said..Thnx again.
>
> Regards,
> Ilavaa
>
>
> On Sat, Jan 5, 2013 at 3:04 PM, alpforce <alpforce_at_bezeqint.net> wrote:
>
>> I totally agree with Alan
>> Had the same problem a while back and solved it just this way. Use the
>> callbacks only to what they are designated for, i.e. reading callback
>> reads the data, writing callback writes it. Don't forget that libcurl is
>> only using those functions to actually do its work :), so if you need to
>> do something with the data, only do that before / after the
>> curl_easy_perform()...
>>
>> Alan Wolfe wrote:
>> > Actually i think i know what your issue is. Curl is single threaded,
>> > even if you use the multi interface. If you are doing a bunch of work
>> > in the callback function, that means that the main thread (the only
>> > thread) is doing that, and not processing data waiting on the line etc.
>> >
>> > Also, usually it's a bad idea to spend a lot of time in callbacks
>> > (whether we are talking about libcurl, another library, or even your
>> > operating system's APIs) and can often cause problems if you do.
>> >
>> > You could have your other data transfer happen on another thread, or
>> > you could write it to disk and fire up another process to send the
>> > data to wherever you are forwarding it on to.
>> >
>> > Hope this helps!
>> >
>> >
>> >
>> >
>> > On Sat, Jan 5, 2013 at 12:09 AM, ilavarasan M <m.ilavarasan_at_gmail.com
>> > <mailto:m.ilavarasan_at_gmail.com>> wrote:
>> >
>> > Hi,
>> >
>> > I'm really stuck up with this problem. can you please help out..?
>> > is there anything I need to check to solve this issue?
>> >
>> > Regards,
>> > Ilavaa
>> >
>> >
>> > On Fri, Dec 28, 2012 at 12:59 PM, ilavarasan M
>> > <m.ilavarasan_at_gmail.com <mailto:m.ilavarasan_at_gmail.com>> wrote:
>> >
>> > Hi,
>> >
>> > Thanks for your reply. I'm yet to investigate the network
>> > connection also I can't get the server side logs now. From my
>> > analyzis I found there will be no network problems happend
>> > because when i ran separate utility which downloads 60GB file
>> > successfully. In my previous program, I do the following process
>> >
>> > 1. Download the contents from remote url
>> > 2. In the call back function, data will be copied to another
>> > buffer which size is 10 MB.
>> > 3. And once the buffer is filled 10 MB i'll send to another
>> > location.
>> > 4. Until the buffer become empty, curl will not download any
>> > contents.
>> > 5. Once buffer emptied curl starts downloading again.
>> >
>> > I feel that, Curl is exited due to the sending to the another
>> > location time is high. Is there any time out or delay for curl
>> > call back function. I'm able to reproduce the issue by put
>> > sleep in the call back function. If there is no delay in
>> > downloading content, everything works fine. I have attaced my
>> > code.
>> >
>> > Is there any option I need to set for this delayed response?
>> >
>> > Thanks & Regards,
>> > Ilavaa.
>> >
>> > On Fri, Dec 21, 2012 at 6:02 PM, Daniel Stenberg
>> > <daniel_at_haxx.se <mailto:daniel_at_haxx.se>> wrote:
>> >
>> > On Fri, 21 Dec 2012, ilavarasan M wrote:
>> >
>> > I'm using the latest version 7.28.1 to download the
>> > files. Im trying to download the file which is 60 GB
>> > in size using cURL (C++). I'm able to get around 17 GB
>> > of content and suddenly cURL come out with return code
>> > as success and the http response code is 200. I try to
>> > debug and found that curl comes out when it receiving
>> > the buffer size less than 16K in the callback
>> > function. I'm getting random values like 4K or 13K. I
>> > can confirm the issue is because of this.
>> >
>> >
>> > No. That is just another sympthom, not the cause, of the
>> > problem. libcurl will provide you with as much data as it
>> > was able to read from the socket.
>> >
>> >
>> > Is there any way to fix this?
>> >
>> >
>> > We don't know what your problem is only based on this. We
>> > don't know what the problem is!
>> >
>> > If I were to investigate that problem I'd A) check the
>> > server side logs for when the failure occurs and B)
>> > wireshark the network and investigate the TCP action at
>> > the time of the transfer stop.
>> >
>> > So curl_easy_perform() returns OK for this transfer? Is
>> > that an old-style HTTP close connection to indicate end of
>> > transfer?
>> >
>> >
>> > can i set the CURL_MAX_WRITE_SIZE
>> >
>> >
>> > That's a compile-time value you can alter when you rebuild
>> > libcurl, but you changing that won't fix this problem...
>> >
>> > --
>> >
>> > / daniel.haxx.se <http://daniel.haxx.se>
>> >
>> -------------------------------------------------------------------
>> > List admin: http://cool.haxx.se/list/listinfo/curl-library
>> > Etiquette: http://curl.haxx.se/mail/etiquette.html
>> >
>> >
>> >
>> >
>> > -------------------------------------------------------------------
>> > List admin: http://cool.haxx.se/list/listinfo/curl-library
>> > Etiquette: http://curl.haxx.se/mail/etiquette.html
>> >
>> >
>> >
>> >
>> > -------------------------------------------------------------------
>> > List admin: http://cool.haxx.se/list/listinfo/curl-library
>> > Etiquette: http://curl.haxx.se/mail/etiquette.html
>> >
>> >
>> > No virus found in this message.
>> > Checked by AVG - www.avg.com <http://www.avg.com>
>> > Version: 2012.0.2221 / Virus Database: 2637/5510 - Release Date:
>> 01/04/13
>> >
>>
>> -------------------------------------------------------------------
>> List admin: http://cool.haxx.se/list/listinfo/curl-library
>> Etiquette: http://curl.haxx.se/mail/etiquette.html
>>
>
>

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-library
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2013-01-28