curl / Mailing Lists / curl-users / Single Mail
Buy commercial curl support from WolfSSL. We help you work out your issues, debug your libcurl applications, use the API, port to new platforms, add new features and more. With a team lead by the curl founder himself.

Re: sort of tangent to curl -- web browser/extension

From: bruce via curl-users <>
Date: Tue, 1 Jun 2021 14:34:33 -0400


The test page/URL I'm looking at for my use case would be:

Selecting the dev tools/network, and then doing an inspection of the
functions in the "network" tab you can see the::

>>>GET - -*
(might need to do a refresh to gen the list of functions/calls for the page)

It's the 4th/5th "json" (type) after the group of "plain" types

I can easily select the "display in diff tab" and gen the content for the URL.

However I'm trying to figure out if there's an extension or a method
to gen/save the content of the page when I'm viewing the top level
URL. The process would have to then gen the content of the associated
URLs which comprise the page.

I rcall seeing some extensions that managed to "track" the item a
person was looking at (selecting) on a page and then generating
comparison pricing data. I would assume that these extensions where
extracting the data from the content and therefore accessing the
content of the page.

Hope this gives a bit more clarity to what I'm attempting to find.


On Tue, Jun 1, 2021 at 1:39 PM Petr Pisar via curl-users
<> wrote:
> V Tue, Jun 01, 2021 at 12:43:17PM -0400, bruce via curl-users napsal(a):
> > The HAR content lists the "network" data as well as we GET url but not
> > the actual content of the page.
> >
> The HAR file is in a JSON format. If you go to "entries" list and pick a item
> whose request/url value matches your desired URL, then in the subsequent
> response/content/text string should be a body of the HTTP response.
> Or what do you mean with "actual content of the page". There is nothing as
> page in HTTP. There are only documents returned for the requests. The page is
> rendered from the documents by a web browser. There won't be any image of
> the "actual content".
> Maybe if you provided us the URL, we could help you.
> -- Petr
> -----------------------------------------------------------
> Unsubscribe:
> Etiquette:
Received on 2021-06-01