Re: I need help getting a web page

From: NAS Kearn via curl-users <curl-users_at_lists.haxx.se>
Date: Mon, 11 Oct 2021 11:37:14 +0100

 If you look at the commits for the repo
<https://gitlab.freedesktop.org/spice/win32/spice-nsis/-/commits/master> it
gives you an option to view the RSS feed. (top right, next to the search)
This will give you an XML file that you can use with CURL & some other
script to get the data you are looking for.

If you do a google search you will be able to find a script that you can
adapt to use for your project. (you want to look for something along the
lines of an XML parser...<insert your most familiar programming language
here>)
doing it with XML saves you from having to download the full repo every
time you want to just get a little bit of data.

See the link below for the XML feed.

https://gitlab.freedesktop.org/spice/win32/spice-nsis/-/commits/master?format=atom


On Sun, 10 Oct 2021 at 23:35, Ilya Basin via curl-users <
curl-users_at_lists.haxx.se> wrote:

> Hi T
> The right column is constructed in the browser on the fly. It's not part
> of the downloaded HTML.
>
> The easiest is to clone this repository with Git and retrieve the info
> from there, but you would have to download the entire repo.
>
> See maybe there's a REST API in Gitlab to query the indexed data from a
> repo, check here: https://docs.gitlab.com/ee/api/index.html
>
>
> On 11.10.2021 1:27, ToddAndMargo via curl-users wrote:
> > Hi All,
> >
> > Fedora 33
> > curl-7.76.1-12.fc34.x86_64
> >
> > This page show something different in Firefox and Vivaldi
> > that I can get with curl.
> >
> > https://gitlab.freedesktop.org/spice/win32/spice-nsis/-/tree/master
> >
> > $ curl
> https://gitlab.freedesktop.org/spice/win32/spice-nsis/-/tree/master >
> eraseme.html
> >
> > I am after the line that says:
> >
> > virtio-win: rebase on 0.164
> >
> > I am trying to extract the "0.164"
> >
> > Looking at eraseme.html, it look like I am only
> > downloading the left column and not the contents
> > on the right side of the page
> >
> > What am I doing wrong?
> >
> > Many thanks,
> > -T
> >
> >
> >
> >
> --
> Unsubscribe: https://lists.haxx.se/listinfo/curl-users
> Etiquette: https://curl.haxx.se/mail/etiquette.html
>

-- 
Unsubscribe: https://lists.haxx.se/listinfo/curl-users
Etiquette:   https://curl.haxx.se/mail/etiquette.html

Received on 2021-10-11