cURL / Mailing Lists / curl-library / Single Mail


Fetching More than 500 files from Server

From: Swamy Mudhbasalar <>
Date: Wed, 13 Jun 2012 10:08:31 +0530


Problem Description:
We are try to fetch files from the ESX server 4.0 through HTTP request
using curl library in C program.
I am using a single easy curl handle to fetch all the files to take
advantage of persistent connection.

But, When tried to fetch more than 500 files from the ESX 4.0 using curl
library fails.

Cause :
Each time while fetching a file a new connection is established. So when
more than 500 connection
is established and fetching of files stops. The established connections are
not getting closed and they remain idle for 30 mins.

Observation :
HTTP Client request Sent:

Host: dev-vcenter-4-2
User-Agent: gSOAP/2.7
Content-Type: text/xml; charset=utf-8
Content-Length: 504
Connection: close
Cookie: ;$Path="/sdk";$Domain="dev-vcenter-4-2"
SOAPAction: "urn:vim25/4.1"

HTTP Server Reponse Recieved :

HTTP/1.1 200 OK
Date: Thu, 7 Jun 2012 13:36:29 GMT
Set-Cookie: vmware_soap_session="C762CF10-B1DF-427A-9E0C-9EB851FFDE3D";
Cache-Control: no-cache
Connection: close
Content-Type: text/xml; charset=utf-8
Content-Length: 1934

Questions :
1. In all HTTP request sent and recieved observed Connection: close ?
2. How to make Connection : Alive and use the same connection to fetch all
the files? What need to added
specificalling in the code to do this ?
3.Why connections are not getting closed and they remain idle for 30 mins?


List admin:
Received on 2012-06-13