Buy commercial curl support from WolfSSL. We help you work
out your issues, debug your libcurl applications, use the API, port to new
platforms, add new features and more. With a team lead by the curl founder
himself.
Re: DNS cache performance
- Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]
From: Sergey Polovko via curl-library <curl-library_at_cool.haxx.se>
Date: Thu, 25 Mar 2021 19:03:19 +0300
Hi Tomalak,
This is done for pulling metrics data from many applications (services) into a centralized monitoring system. Something similar to Prometheus but at scale. Making 3K requests per second is not such big deal thou. And libcurl does it pretty well. The problem only in the current implementation of the cache, which I think can be easily improved.
Best
> On 25 Mar 2021, at 18:43, Tomalak Geret'kal via curl-library <curl-library_at_cool.haxx.se> wrote:
>
> On 25/03/2021 15:28, Sergey Polovko via curl-library wrote:
>> 40K - 60K of hosts every 15 seconds, performing around 3K requests per second
>
> :O
>
> What sort of use case is this?
>
> This strikes me as an edge case for any software.
>
> Cheers
>
> -------------------------------------------------------------------
> Unsubscribe: https://cool.haxx.se/list/listinfo/curl-library
> Etiquette: https://curl.se/mail/etiquette.html
-------------------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-library
Etiquette: https://curl.se/mail/etiquette.html
Received on 2021-03-25
Date: Thu, 25 Mar 2021 19:03:19 +0300
Hi Tomalak,
This is done for pulling metrics data from many applications (services) into a centralized monitoring system. Something similar to Prometheus but at scale. Making 3K requests per second is not such big deal thou. And libcurl does it pretty well. The problem only in the current implementation of the cache, which I think can be easily improved.
Best
> On 25 Mar 2021, at 18:43, Tomalak Geret'kal via curl-library <curl-library_at_cool.haxx.se> wrote:
>
> On 25/03/2021 15:28, Sergey Polovko via curl-library wrote:
>> 40K - 60K of hosts every 15 seconds, performing around 3K requests per second
>
> :O
>
> What sort of use case is this?
>
> This strikes me as an edge case for any software.
>
> Cheers
>
> -------------------------------------------------------------------
> Unsubscribe: https://cool.haxx.se/list/listinfo/curl-library
> Etiquette: https://curl.se/mail/etiquette.html
-------------------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-library
Etiquette: https://curl.se/mail/etiquette.html
Received on 2021-03-25