Buy commercial curl support from WolfSSL. We help you work
out your issues, debug your libcurl applications, use the API, port to new
platforms, add new features and more. With a team lead by the curl founder
himself.
Re: sort of tangent to curl -- web browser/extension
- Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]
From: bruce via curl-users <curl-users_at_cool.haxx.se>
Date: Tue, 1 Jun 2021 14:34:33 -0400
Hi.
The test page/URL I'm looking at for my use case would be:
https://www.bkstr.com/efollettstore/home
Selecting the dev tools/network, and then doing an inspection of the
functions in the "network" tab you can see the::
>>>GET - svc.bkstr.com - https://svc.bkstr.com/store/byName?storeType=FMS&catalogId=10001&langId=-1&schoolName=*
(might need to do a refresh to gen the list of functions/calls for the page)
It's the 4th/5th "json" (type) after the group of "plain" types
I can easily select the "display in diff tab" and gen the content for the URL.
However I'm trying to figure out if there's an extension or a method
to gen/save the content of the page when I'm viewing the top level
URL. The process would have to then gen the content of the associated
URLs which comprise the page.
I rcall seeing some extensions that managed to "track" the item a
person was looking at (selecting) on a page and then generating
comparison pricing data. I would assume that these extensions where
extracting the data from the content and therefore accessing the
content of the page.
Hope this gives a bit more clarity to what I'm attempting to find.
Thanks
On Tue, Jun 1, 2021 at 1:39 PM Petr Pisar via curl-users
<curl-users_at_cool.haxx.se> wrote:
>
> V Tue, Jun 01, 2021 at 12:43:17PM -0400, bruce via curl-users napsal(a):
> > The HAR content lists the "network" data as well as we GET url but not
> > the actual content of the page.
> >
> The HAR file is in a JSON format. If you go to "entries" list and pick a item
> whose request/url value matches your desired URL, then in the subsequent
> response/content/text string should be a body of the HTTP response.
>
> Or what do you mean with "actual content of the page". There is nothing as
> page in HTTP. There are only documents returned for the requests. The page is
> rendered from the documents by a web browser. There won't be any image of
> the "actual content".
>
> Maybe if you provided us the URL, we could help you.
>
> -- Petr
> -----------------------------------------------------------
> Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
> Etiquette: https://curl.haxx.se/mail/etiquette.html
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.haxx.se/mail/etiquette.html
Received on 2021-06-01
Date: Tue, 1 Jun 2021 14:34:33 -0400
Hi.
The test page/URL I'm looking at for my use case would be:
https://www.bkstr.com/efollettstore/home
Selecting the dev tools/network, and then doing an inspection of the
functions in the "network" tab you can see the::
>>>GET - svc.bkstr.com - https://svc.bkstr.com/store/byName?storeType=FMS&catalogId=10001&langId=-1&schoolName=*
(might need to do a refresh to gen the list of functions/calls for the page)
It's the 4th/5th "json" (type) after the group of "plain" types
I can easily select the "display in diff tab" and gen the content for the URL.
However I'm trying to figure out if there's an extension or a method
to gen/save the content of the page when I'm viewing the top level
URL. The process would have to then gen the content of the associated
URLs which comprise the page.
I rcall seeing some extensions that managed to "track" the item a
person was looking at (selecting) on a page and then generating
comparison pricing data. I would assume that these extensions where
extracting the data from the content and therefore accessing the
content of the page.
Hope this gives a bit more clarity to what I'm attempting to find.
Thanks
On Tue, Jun 1, 2021 at 1:39 PM Petr Pisar via curl-users
<curl-users_at_cool.haxx.se> wrote:
>
> V Tue, Jun 01, 2021 at 12:43:17PM -0400, bruce via curl-users napsal(a):
> > The HAR content lists the "network" data as well as we GET url but not
> > the actual content of the page.
> >
> The HAR file is in a JSON format. If you go to "entries" list and pick a item
> whose request/url value matches your desired URL, then in the subsequent
> response/content/text string should be a body of the HTTP response.
>
> Or what do you mean with "actual content of the page". There is nothing as
> page in HTTP. There are only documents returned for the requests. The page is
> rendered from the documents by a web browser. There won't be any image of
> the "actual content".
>
> Maybe if you provided us the URL, we could help you.
>
> -- Petr
> -----------------------------------------------------------
> Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
> Etiquette: https://curl.haxx.se/mail/etiquette.html
-----------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-users
Etiquette: https://curl.haxx.se/mail/etiquette.html
Received on 2021-06-01