curl / Mailing Lists / curl-users / Single Mail
Buy commercial curl support from WolfSSL. We help you work out your issues, debug your libcurl applications, use the API, port to new platforms, add new features and more. With a team lead by the curl founder himself.

Re: working around status code 429

From: Ray Satiro via curl-users <curl-users_at_lists.haxx.se>
Date: Fri, 26 Jan 2024 02:28:16 -0500

On 1/25/2024 5:10 AM, Dirk Hünniger via curl-users wrote:
>
> I attached the output of
>
> curl --retry 30 -v -w "%{http_code} %{url} %{filename_effective}\n"
> --compressed -K ./curlrun1 --parallel -L > out 2>&1
>
> but the file is so large that I cannot really work with well it in gedit.
>

The output shows that the transfers that return HTTP 429 have failed
with curl error CURLE_WRITE_ERROR (23) and that is at least one reason
why they are not being retried. You can try with the latest version of
curl but I suspect this is not going to be a curl issue. Also, if gedit
isn't working for you then use something else. There's no reason you
shouldn't be able to work with large files like that in a text editor.

Here's one example. They all look the same:

Warning: Failed to create the file
Warning: /tmp/MediaWiki2LaTeXImages-3943f5a7379c6219/827.4.html: No such
file
Warning: or directory
* Failure writing output to destination
* stopped the pause stream!
curl: (23) Failure writing output to destination


-- 
Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
Etiquette:   https://curl.se/mail/etiquette.html
Received on 2024-01-26