Buy commercial curl support from WolfSSL. We help you work
out your issues, debug your libcurl applications, use the API, port to new
platforms, add new features and more. With a team lead by the curl founder
himself.
RE: sort of tangent to curl -- web browser/extension
- Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]
From: Bill Mercer via curl-users <curl-users_at_cool.haxx.se>
Date: Wed, 2 Jun 2021 21:54:46 +0000
> -----Original Message-----
> From: curl-users <curl-users-bounces_at_cool.haxx.se> On Behalf Of bruce via
> curl-users
> Sent: Wednesday, June 2, 2021 4:27 PM
> To: the curl tool <curl-users_at_cool.haxx.se>
> Cc: bruce <badouglas_at_gmail.com>
> Subject: Re: sort of tangent to curl -- web browser/extension
>
> Hi Petr.
>
> Thanks so much for your time on this.
>
> As far as I can tell. It appears that the overall sit/process uses "blocking" tech
> from perimterX. This combines with recaptcha and other processes to impact
> the ability to access the data. Even using the browser/tabs too fast will
> generate issues.
Honestly, if the site owners are going to these lengths to prevent you from doing what you're trying to do, you may want to reevaluate whether it's worth the effort.
> I'm thinking a possible solution might be to go in a "different"
> direction via some sort of browser extension which would access the content
> and then send the content off to a extern server for parsing/processing.
This sounds a lot like capturing a HAR and replaying it.
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.haxx.se/mail/etiquette.html
Received on 2021-06-02
Date: Wed, 2 Jun 2021 21:54:46 +0000
> -----Original Message-----
> From: curl-users <curl-users-bounces_at_cool.haxx.se> On Behalf Of bruce via
> curl-users
> Sent: Wednesday, June 2, 2021 4:27 PM
> To: the curl tool <curl-users_at_cool.haxx.se>
> Cc: bruce <badouglas_at_gmail.com>
> Subject: Re: sort of tangent to curl -- web browser/extension
>
> Hi Petr.
>
> Thanks so much for your time on this.
>
> As far as I can tell. It appears that the overall sit/process uses "blocking" tech
> from perimterX. This combines with recaptcha and other processes to impact
> the ability to access the data. Even using the browser/tabs too fast will
> generate issues.
Honestly, if the site owners are going to these lengths to prevent you from doing what you're trying to do, you may want to reevaluate whether it's worth the effort.
> I'm thinking a possible solution might be to go in a "different"
> direction via some sort of browser extension which would access the content
> and then send the content off to a extern server for parsing/processing.
This sounds a lot like capturing a HAR and replaying it.
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.haxx.se/mail/etiquette.html
Received on 2021-06-02