curl / Mailing Lists / curl-users / Single Mail

Buy commercial curl support from WolfSSL. We help you work out your issues, debug your libcurl applications, use the API, port to new platforms, add new features and more. With a team lead by the curl founder himself.

Re: Problem downloading via curl

From: Dominik Neudert-Schulz via curl-users <curl-users_at_cool.haxx.se>
Date: Mon, 15 Jul 2019 10:44:40 +0200

Hi!

14.07.19 at 16:01 Daniel Stenberg wrote:
> On Fri, 12 Jul 2019, Dominik via curl-users wrote:
>
>> However, using wget the download works:
>
>> (registrationcenter-download.intel.com)|23.58.216.6|:80 … verbunden.
>
> Interstingly enough, that one used a different IP. Maybe that explains it? Or maybe the server otherwise detects user-agent somehow and acts differently?

No that does not seem to be the problem. I get two different IP addresses for this host (after waiting some time):

   $> dig registrationcenter-download.intel.com
   [...]
   registrationcenter-download.intel.com. 300 IN CNAME registrationcenter.intel.com.edgekey.net.
   registrationcenter.intel.com.edgekey.net. 19903 IN CNAME e11.dscd.akamaiedge.net.
   e11.dscd.akamaiedge.net. 19 IN A 23.194.204.4
   [...]

   $> dig registrationcenter-download.intel.com
   [...]
   registrationcenter-download.intel.com. 80 IN CNAME registrationcenter.intel.com.edgekey.net.
   registrationcenter.intel.com.edgekey.net. 21379 IN CNAME e11.dscd.akamaiedge.net.
   e11.dscd.akamaiedge.net. 4 IN A 23.58.216.6
   [...]

I can use both with wget if I send an additional header.

$> wget http://23.58.216.6/akdlm/irc_nas/tec/15268/parallel_studio_xe_2019_update3_cluster_edition.tgz --header "Host: registrationcenter-download.intel.com"

This did not work with curl:

$> curl -O --trace-ascii - -H "Host: registrationcenter-download.intel.com"
http://23.58.216.6/akdlm/irc_nas/tec/15268/parallel_studio_xe_2019_update3_cluster_edition.tgz

   == Info: Trying 23.58.216.6:80...
   == Info: TCP_NODELAY set
     % Total % Received % Xferd Average Speed Time Time Time Current
                                    Dload Upload Total Spent Left Speed
     0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0== Info: Connected to 23.58.216.6 (23.58.216.6) port 80 (#0)
   => Send header, 176 bytes (0xb0)
   0000: GET /akdlm/irc_nas/tec/15268/parallel_studio_xe_2019_update3_clu
   0040: ster_edition.tgz HTTP/1.1
   005b: Host: registrationcenter-download.intel.com
   0088: User-Agent: curl/7.65.1
   00a1: Accept: */*
   00ae:
     0 0 0 0 0 0 0 0 --:--:-- 0:00:16 --:--:-- 0

I forgot to send the curl version in my previous email:

   $> curl --version
   curl 7.65.1 (x86_64-pc-linux-gnu) libcurl/7.65.1 OpenSSL/1.1.1c zlib/1.2.11 libidn2/2.2.0 libpsl/0.21.0 (+libidn2/2.2.0) libssh2/1.8.2 nghttp2/1.36.0
   Release-Date: 2019-06-05
   Protocols: dict file ftp ftps gopher http https imap imaps pop3 pop3s rtsp scp sftp smb smbs smtp smtps telnet tftp
   Features: AsynchDNS GSS-API HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL TLS-SRP UnixSockets

Thanks for the reply!
Dominik
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.haxx.se/mail/etiquette.html
Received on 2019-07-15

This message: [ Message body ]
Next message: Daniel Stenberg via curl-users: "Re: Is it possiable to let curl close the connection when the download speed is higher than or equal to specific value?"
Previous message: Hongyi Zhao via curl-users: "Is it possiable to let curl close the connection when the download speed is higher than or equal to specific value?"
In reply to: Daniel Stenberg via curl-users: "Re: Problem downloading via curl"

Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]