curl / Mailing Lists / curl-users / Single Mail

Buy commercial curl support from WolfSSL. We help you work out your issues, debug your libcurl applications, use the API, port to new platforms, add new features and more. With a team lead by the curl founder himself.

Re: curl and etag usage (--etag-save and --etag-compare)?

Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]

From: Daniel Stenberg via curl-users <curl-users_at_lists.haxx.se>
Date: Mon, 7 Mar 2022 09:44:10 +0100 (CET)

On Sun, 6 Mar 2022, jacques granduel via curl-users wrote:

> I need to download thousands of documents, but the server manages *etags*.
> As of version curl-7.68, curl has 2 options for dealing with etags
> (--etag-save <file> and --etag-compare <file>). So etags can be saved for
> later comparisons. But it seems that the only built way is to use an etag
> file per downloaded file, which is cumbersome.

If you only want to download the documents then I figure you can just skip
etags. But since you ask, I presume you want to periodically update them as
well and then you indeed want to use etags.

> What's the best way to use --etag-save/--etag-compare with thousands
> downloads?

I think it would need some tweaks to be really good for this use case.

-- 
  / daniel.haxx.se
  | Commercial curl support up to 24x7 is available!
  | Private help, bug fixes, support, ports, new features
  | https://curl.se/support.html
-- 
Unsubscribe: https://lists.haxx.se/listinfo/curl-users
Etiquette:   https://curl.haxx.se/mail/etiquette.html

Received on 2022-03-07

This message: [ Message body ]
Next message: Paul Gilmartin via curl-users: "--etag-compare vs. --time-cond"
Previous message: Timothe Litt: "Re: curl and etag usage (--etag-save and --etag-compare)?"
In reply to: jacques granduel via curl-users: "curl and etag usage (--etag-save and --etag-compare)?"

Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]