Buy commercial curl support. We
help you work out your issues, debug your libcurl applications, use the API,
port to new platforms, add new features and more. With a team lead by the
curl founder Daniel himself.
Re: Tip: impersonate that actually works
- Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]
From: bruce via curl-users <curl-users_at_lists.haxx.se>
Date: Tue, 28 Oct 2025 08:22:18 -0400
right.. which is.. get the browser developer tab.. see what curl procee
and it has.. use it...
it's normally all there.. and u can see how the javascript stuff is
handled as well if any is on the site
On Tue, Oct 28, 2025, 7:46 AM Bastian Jesuiter via curl-users <
curl-users_at_lists.haxx.se> wrote:
> Hi,
>
> Exactly that's the reason, why I did recommend you previously to compare
> what the browser does compared to your curl requests.
>
> Your browser will most likely include several additional headers:
>
> accept,
> authorization,
> Cookie,
> User-Agent,
>
> The new secure user agent strings (although not many servers check it yet)
>
> Your curl requests most likely do not include those headers or if it does
> it may include the headers in a form the server blocks.
>
> You can check what your curl is sending either using -v (--verbose) or by
> using a proxy with debugging capabilities.
>
> Check the response your browser receives.
> It may include a "set-cookie" response header, which you most likely
> ignore with current scripts unless you used the cookie related parameters
> in curl.
>
> Tell your script to send proper headers.
>
> Otherwise you will always be blocked.
>
> Good luck,
>
> Bastian
>
> On Tue, Oct 28, 2025, 12:32 ToddAndMargo via curl-users <
> curl-users_at_lists.haxx.se> wrote:
>
>> Hi All,
>>
>> There are two curl-impersonate's out there.
>> The first is lwthiker's and it is poorly
>> maintained
>>
>> https://github.com/lwthiker/curl-impersonate
>>
>> Web sites I have used it on only allow once, then
>> your get froze out. You have to change scripts.
>> It is like the other end is learning you. And
>> the other end eventually learns all the scrips.
>>
>> The other that is lexiforest's. It is maintained,
>> actually works, and works well is
>>
>> https://github.com/lexiforest/curl-impersonate
>> https://github.com/lexiforest/curl-impersonate/releases
>>
>> HTH someone else,
>> -T
>>
>> --
>> Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
>> Etiquette: https://curl.se/mail/etiquette.html
>>
> --
> Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
> Etiquette: https://curl.se/mail/etiquette.html
>
Date: Tue, 28 Oct 2025 08:22:18 -0400
right.. which is.. get the browser developer tab.. see what curl procee
and it has.. use it...
it's normally all there.. and u can see how the javascript stuff is
handled as well if any is on the site
On Tue, Oct 28, 2025, 7:46 AM Bastian Jesuiter via curl-users <
curl-users_at_lists.haxx.se> wrote:
> Hi,
>
> Exactly that's the reason, why I did recommend you previously to compare
> what the browser does compared to your curl requests.
>
> Your browser will most likely include several additional headers:
>
> accept,
> authorization,
> Cookie,
> User-Agent,
>
> The new secure user agent strings (although not many servers check it yet)
>
> Your curl requests most likely do not include those headers or if it does
> it may include the headers in a form the server blocks.
>
> You can check what your curl is sending either using -v (--verbose) or by
> using a proxy with debugging capabilities.
>
> Check the response your browser receives.
> It may include a "set-cookie" response header, which you most likely
> ignore with current scripts unless you used the cookie related parameters
> in curl.
>
> Tell your script to send proper headers.
>
> Otherwise you will always be blocked.
>
> Good luck,
>
> Bastian
>
> On Tue, Oct 28, 2025, 12:32 ToddAndMargo via curl-users <
> curl-users_at_lists.haxx.se> wrote:
>
>> Hi All,
>>
>> There are two curl-impersonate's out there.
>> The first is lwthiker's and it is poorly
>> maintained
>>
>> https://github.com/lwthiker/curl-impersonate
>>
>> Web sites I have used it on only allow once, then
>> your get froze out. You have to change scripts.
>> It is like the other end is learning you. And
>> the other end eventually learns all the scrips.
>>
>> The other that is lexiforest's. It is maintained,
>> actually works, and works well is
>>
>> https://github.com/lexiforest/curl-impersonate
>> https://github.com/lexiforest/curl-impersonate/releases
>>
>> HTH someone else,
>> -T
>>
>> --
>> Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
>> Etiquette: https://curl.se/mail/etiquette.html
>>
> --
> Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
> Etiquette: https://curl.se/mail/etiquette.html
>
-- Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users Etiquette: https://curl.se/mail/etiquette.htmlReceived on 2025-10-28