Re: You've been blocked

From: bruce via curl-users <curl-users_at_lists.haxx.se>
Date: Sat, 18 Oct 2025 12:48:58 -0400

Hi.

Lurking/saw this thread. I have no clue as to your level of expertise.
I don't know what browser you're using as a test. It does appear
you've used some browser, as you can get to the target page.

As a test, use the browser/url, and the "developer" tabs to find the
"curl" function as defined by the browser. This would get the complete
attributes used in the command.

Do this, test it if you find the browser cmd, and post the command if
it's not working...

good luck


On Sat, Oct 18, 2025 at 9:51 AM ToddAndMargo via curl-users
<curl-users_at_lists.haxx.se> wrote:
>
> On 10/18/25 6:44 AM, ToddAndMargo via curl-users wrote:
> >>> On Sat, Oct 18, 2025 at 1:22 PM ToddAndMargo via curl-users <curl-
> >>> users_at_lists.haxx.se <mailto:curl-users_at_lists.haxx.se>> wrote:
> >>>
> >>> On 10/18/25 3:06 AM, Daniel Stenberg wrote:
> >>> > On Sat, 18 Oct 2025, ToddAndMargo via curl-users wrote:
> >>> >
> >>> >> How do I get around "You've been blocked" on this web sire:
> >>> >
> >>> > Presumably you get blocked by a site if you somehow violate their
> >>> terms
> >>> > or use or their perception of good behavior.
> >>> >
> >>> > A primary way to not get blocked would be to not do that. To
> >>> understand
> >>> > the exact specifics and reasons, you would have to ask the admins
> >>> of the
> >>> > website in question.
> >>> >
> >>>
> >>> I am not doing anything different than I ever do.
> >>> Do you see anything wrong with my code?
> >>> -- Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-
> >>> users
> >>> <https://lists.haxx.se/mailman/listinfo/curl-users>
> >>> Etiquette: https://curl.se/mail/etiquette.html <https://curl.se/
> >>> mail/etiquette.html>
> >>>
> >>>
> >
> > On 10/18/25 6:29 AM, Bastian Jesuiter via curl-users wrote:
> >> You didnt even post code.
> >
> > From my original post:
> >
> > curl -L https://www.softpedia.com/get/System/Back-Up-and-Recovery/
> > Icedrive.shtml#download -o eraseme.html
> >
> >> But regardless of that - if you get blocked, you'll need to resolve
> >> that with the admin of the page.
> >> Maybe you can even ask (them) if you may get an API Documentation for
> >> Developers and or explain what your use case is and how you should
> >> proceed.
> >> Some websites are explicitly custom fetching, others - like the
> >> icedrive website you shared recently - do not.
> >>
> >> You are most likely being catched by an AI Crawler blocker. Presumably
> >> because your requests are similar to the behavior of an AI or
> >> otherwise automated scraper.
> >> Dont do that.
> >
> > Curl does that?
> >
> >> Try to find dev documentation or ask the service admin as Daniel said.
> >>
> >> ---
> >> Bastian
> >
> > The web page that I get states:
> >
> > What can I do to resolve this?
> >
> > You can email the site owner to let them know you
> > were blocked. Please include what you were doing
> > when this page came up and the Cloudflare Ray ID
> > found at the bottom of this page.
> >
> > Cloudflare Ray ID: 990732037c51c798 • Your IP:
> > • Performance & security by Cloudflare
> >
> > And there is noting at the bottom of the page.
> >
>
>
> I just wrote Softpedia
> --
> Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
> Etiquette: https://curl.se/mail/etiquette.html

-- 
Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
Etiquette:   https://curl.se/mail/etiquette.html

Received on 2025-10-18