Re: You've been blocked

From: ToddAndMargo via curl-users <curl-users_at_lists.haxx.se>
Date: Sat, 18 Oct 2025 06:44:43 -0700

>> On Sat, Oct 18, 2025 at 1:22 PM ToddAndMargo via curl-users <curl-
>> users_at_lists.haxx.se <mailto:curl-users_at_lists.haxx.se>> wrote:
>>
>> On 10/18/25 3:06 AM, Daniel Stenberg wrote:
>> > On Sat, 18 Oct 2025, ToddAndMargo via curl-users wrote:
>> >
>> >> How do I get around "You've been blocked" on this web sire:
>> >
>> > Presumably you get blocked by a site if you somehow violate their
>> terms
>> > or use or their perception of good behavior.
>> >
>> > A primary way to not get blocked would be to not do that. To
>> understand
>> > the exact specifics and reasons, you would have to ask the admins
>> of the
>> > website in question.
>> >
>>
>> I am not doing anything different than I ever do.
>> Do you see anything wrong with my code?
>> --
>> Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
>> <https://lists.haxx.se/mailman/listinfo/curl-users>
>> Etiquette: https://curl.se/mail/etiquette.html <https://curl.se/
>> mail/etiquette.html>
>>
>>

On 10/18/25 6:29 AM, Bastian Jesuiter via curl-users wrote:
> You didnt even post code.

 From my original post:

curl -L
https://www.softpedia.com/get/System/Back-Up-and-Recovery/Icedrive.shtml#download
-o eraseme.html

> But regardless of that - if you get blocked, you'll need to resolve that
> with the admin of the page.
> Maybe you can even ask (them) if you may get an API Documentation for
> Developers and or explain what your use case is and how you should proceed.
> Some websites are explicitly custom fetching, others - like the icedrive
> website you shared recently - do not.
>
> You are most likely being catched by an AI Crawler blocker. Presumably
> because your requests are similar to the behavior of an AI or otherwise
> automated scraper.
> Dont do that.

Curl does that?

> Try to find dev documentation or ask the service admin as Daniel said.
>
> ---
> Bastian

The web page that I get states:

       What can I do to resolve this?

       You can email the site owner to let them know you
       were blocked. Please include what you were doing
       when this page came up and the Cloudflare Ray ID
       found at the bottom of this page.

       Cloudflare Ray ID: 990732037c51c798 • Your IP:
       • Performance & security by Cloudflare

And there is noting at the bottom of the page.

-- 
Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
Etiquette:   https://curl.se/mail/etiquette.html

Received on 2025-10-18