cURL / Mailing Lists / curl-library / Single Mail

curl-library

Download performance

From: Jacky Lam <sylam_at_emsoftltd.com>
Date: Wed, 27 Mar 2002 13:10:11 +0800

Hi,

        I wonder that whether I am doing some unclever.
        I have a program using libcurl to download web pages and related images.
        The program will spawn a number of threads. Each thread will call
curl_easy_init(), curl_easy_perform() ,curl_easy_cleanup() independently.
(Is it good?)

        Can I download more than 1 object with the same handle in one thread?
(someone is working on that now?)

        Also, I find that each thread will try to resolve the same host name. Is
there any DNS caching in libcurl?

        Actually, I am using libcurl to replace libwww. When the network bandwidth
is enough, download speed of multi-threaded libcurl is impressive (doubly
faster than libwww, even not tuned). But when the network is congested,
libcurl is serveral times slower than libwww. I will happy to work on that if
someone has any idea.

        Thx.

Jacky
Received on 2002-03-27