cURL / Mailing Lists / curl-library / Single Mail

curl-library

Implications? (was: Introducing HTTP Pipelining support)

From: Michael Wallner <mike_at_iworks.at>
Date: Sun, 10 Sep 2006 11:08:25 +0200

Daniel Stenberg wrote:

> I just committed a fairly big commit, and this is the blurb from CHANGES:

Hi, with libcurl-7.16.0-CVS from yesterday, I get lots of errors for my multi
interface, I wonder if these are caused by the changes for the pipelining support,
and whether those changes impact runs without CURLMOPT_PIPELINING?

I didn't dive into the commits yet, so I'll just post the output of my test script
http://cvs.php.net/viewvc.cgi/pecl/http/tests/HttpRequestPool_003.phpt?revision=1.4&view=markup
right here (watch out, it's just PHP), which tries to fetch about 30 URLs with a concurrency of 10.

The first run was done with libcurl-7.15.1 and the second was done with aforementioned
CVS checkout. As you can see I very often get "couldn't connect to server" back from
libcurl (the other warnings origin from my binding).

Thanks for listening.

-TEST
200 http://www.ripe.net 29188
200 http://www.mysql.com 10915
200 http://www.iana.org 4766
304 http://www.oracle.com 0
200 http://www.yahoo.com 10025
200 http://www.heise.de 31610
200 http://www.amazon.com 103590
200 http://www.google.com 2962
200 http://www.opensource.org 11322
200 http://www.microsoft.com 30849
200 http://www.ibm.com 25154
200 http://www.dell.com 18827
403 http://www.wikipedia.org 1068
200 http://www.chip.de 98350
200 http://www.hp.com 55495
200 http://www.cnn.com 103183
304 http://www.netcraft.com 0
200 http://www.mit.edu 16919
200 http://www.cert.org 15899
200 http://www.ca.com 20797
200 http://www.uefa.com 30852
200 http://www.ebay.com 55945
200 http://www.nist.gov 37251
200 http://www.sony.com 448
200 http://www.ieee.org 40377
304 http://www.playstation.com 0
304 http://www.supermicro.com 0
200 http://www.symantec.com 27881
200 http://www.apple.com 8143
200 http://www.bbc.co.uk 43809
304 http://www.fujitsu.com 0
200 http://www.msn.com 11934
200 http://www.foxnews.com 81668
200 http://news.google.com 137431
200 http://www.ecma.com 24492
200 http://www.cbs.com 43628
200 http://www.sky.com 49777
200 http://www.news.com 74441
200 http://www.wired.com 35317
200 http://www.hotmail.com 10056
200 http://www.cnet.com 118146
200 http://slashdot.org 50547
200 http://www.nbc.com 97033
200 http://www.zdnet.com 68045
304 http://www.un.org 0
200 http://www.usatoday.com 81731
200 http://www.bloglines.com 11141
200 http://www.newslink.org 19459
200 http://www.techweb.com 116188
Elapsed: 31.086s
Done

-TEST

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.opensource.org/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Empty or too short HTTP message: '' in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
0 http://www.opensource.org 0

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.amazon.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Empty or too short HTTP message: '' in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
0 http://www.amazon.com 0
200 http://www.iana.org 4766
200 http://www.ripe.net 29188
304 http://www.oracle.com 0
200 http://www.mysql.com 11246
200 http://www.yahoo.com 10024

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.google.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
200 http://www.ibm.com 25087
302 http://www.google.com 218
200 http://www.microsoft.com 30849

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.cnn.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.netcraft.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
200 http://www.cnn.com 103095
200 http://www.chip.de 98347
302 http://www.netcraft.com 278

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.news.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.ca.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Truncated message: chunk size 4389 exceeds remaining data size 4344 at pos 16274 of 20618 in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
200 http://www.dell.com 18827
403 http://www.wikipedia.org 1072
302 http://www.news.com 204
200 http://www.ca.com 20590
200 http://www.heise.de 30749

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.playstation.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Empty or too short HTTP message: '' in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.hp.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Truncated message: chunk size 5275 exceeds remaining data size 4338 at pos 23879 of 28217 in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.cnet.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Truncated message: chunk size 139 exceeds remaining data size 117 at pos 17100 of 17217 in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
0 http://www.playstation.com 0
304 http://www.mit.edu 0
200 http://www.hp.com 28153
200 http://www.cnet.com 16715

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.zdnet.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Empty or too short HTTP message: '' in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.nist.gov/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Truncated message: chunk size 3047 exceeds remaining data size 2915 at pos 5 of 2920 in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
0 http://www.zdnet.com 0
200 http://www.uefa.com 30852
200 http://www.nist.gov 2915

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.hotmail.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Empty or too short HTTP message: '' in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.apple.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Notice: HttpRequestPool::socketPerform(): The Content-Length header pretends a larger body than actually received (expected 8143 bytes; got 3798 bytes) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
0 http://www.hotmail.com 0
200 http://www.apple.com 3798
200 http://www.ieee.org 40377

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.bbc.co.uk/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Empty or too short HTTP message: '' in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.cert.org/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Truncated message: chunk size 1410 exceeds remaining data size 1276 at pos 5 of 1281 in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
0 http://www.bbc.co.uk 0
304 http://www.fujitsu.com 0
304 http://www.symantec.com 0
200 http://www.sony.com 448
200 http://www.ebay.com 55946
200 http://www.cert.org 1276

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.wired.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Empty or too short HTTP message: '' in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
0 http://www.wired.com 0
200 http://www.ecma.com 24492
304 http://www.supermicro.com 0

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://slashdot.org/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Warning: HttpRequestPool::socketPerform(): Empty or too short HTTP message: '' in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
0 http://slashdot.org 0
304 http://www.nbc.com 0
200 http://www.cbs.com 0
200 http://www.sky.com 49773
200 http://www.msn.com 11931
304 http://www.un.org 0
200 http://www.bloglines.com 11143

Warning: HttpRequestPool::socketPerform(): couldn't connect to server; (http://www.foxnews.com/) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62

Notice: HttpRequestPool::socketPerform(): The Content-Length header pretends a larger body than actually received (expected 81668 bytes; got 72204 bytes) in /home/mike/cvs/pecl/http/tests/HttpRequestPool_003.php on line 62
200 http://www.foxnews.com 72204
200 http://www.newslink.org 19459
200 http://news.google.com 138007
200 http://www.techweb.com 112784
200 http://www.usatoday.com 81731
Elapsed: 18.680s
Done

-- 
Michael
Received on 2006-09-10