Buy commercial curl support from WolfSSL. We help you work
out your issues, debug your libcurl applications, use the API, port to new
platforms, add new features and more. With a team lead by the curl founder
himself.
Re: roadmap 2022 thoughts?
- Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]
From: James Read via curl-library <curl-library_at_lists.haxx.se>
Date: Mon, 10 Jan 2022 03:11:52 +0000
On Thu, Jan 6, 2022 at 10:55 PM Daniel Stenberg <daniel_at_haxx.se> wrote:
> On Thu, 6 Jan 2022, James Read via curl-library wrote:
>
> > Extensive testing with epoll has showed limitations in the speed up when
> > using concurrent connections.
>
> Have you ruled out that these limitations aren't just the results of bugs
> or
> plain inefficiencies in the code?
>
> > Perhaps it would be useful to add support for PACKET_MMAP style
> > communication to get more speed up out of it.
>
> In general I'm in favor of adventures to improve performance. Doing
> PACKET_MMAP style networking sounds like the TLS layer would also need
> some
> serious adjustments, so quite a hefty effort probably. Optimized transfers
> for
> clear-text only would feel a tad bit too much like 2016 or so! :-)
>
I've just done some preliminary tests with PACKET_MMAP, nothing too fancy
just some SYN packets to a list of a few million web servers, and it's
fast. Like so fast it overwhelms the NIC and you have to rate limit it. I
definitely think it would be worth the work to add support for PACKET_MMAP
style communication. The speed up is just phenomenal.
James Read
>
> --
>
> / daniel.haxx.se
> | Commercial curl support up to 24x7 is available!
> | Private help, bug fixes, support, ports, new features
> | https://curl.se/support.html
>
Date: Mon, 10 Jan 2022 03:11:52 +0000
On Thu, Jan 6, 2022 at 10:55 PM Daniel Stenberg <daniel_at_haxx.se> wrote:
> On Thu, 6 Jan 2022, James Read via curl-library wrote:
>
> > Extensive testing with epoll has showed limitations in the speed up when
> > using concurrent connections.
>
> Have you ruled out that these limitations aren't just the results of bugs
> or
> plain inefficiencies in the code?
>
> > Perhaps it would be useful to add support for PACKET_MMAP style
> > communication to get more speed up out of it.
>
> In general I'm in favor of adventures to improve performance. Doing
> PACKET_MMAP style networking sounds like the TLS layer would also need
> some
> serious adjustments, so quite a hefty effort probably. Optimized transfers
> for
> clear-text only would feel a tad bit too much like 2016 or so! :-)
>
I've just done some preliminary tests with PACKET_MMAP, nothing too fancy
just some SYN packets to a list of a few million web servers, and it's
fast. Like so fast it overwhelms the NIC and you have to rate limit it. I
definitely think it would be worth the work to add support for PACKET_MMAP
style communication. The speed up is just phenomenal.
James Read
>
> --
>
> / daniel.haxx.se
> | Commercial curl support up to 24x7 is available!
> | Private help, bug fixes, support, ports, new features
> | https://curl.se/support.html
>
-- Unsubscribe: https://lists.haxx.se/listinfo/curl-library Etiquette: https://curl.haxx.se/mail/etiquette.htmlReceived on 2022-01-10