Buy commercial curl support from WolfSSL. We help you work
out your issues, debug your libcurl applications, use the API, port to new
platforms, add new features and more. With a team lead by the curl founder
himself.
Re: I need help getting a web page
- Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]
From: ToddAndMargo via curl-users <curl-users_at_lists.haxx.se>
Date: Tue, 12 Oct 2021 03:45:06 -0700
On 10/12/21 03:04, Hans Henrik Bergan via curl-users wrote:
> ry digging this company name out of the HTML:
> <span>AT&T</span>
>
> the correct translation, as a proper HTML parser will get you: AT&T
> what a regex extraction will get you: AT&T
> try digging the title out of this link:
> <a href="foo" title="5>3"> Mathematical proof that 5 is greater than 3! </a>
>
> a regex extraction is very likely to fail here, and extract 3">
> Mathematical(...)
> while a proper HTML parser will have no problem, and correctly parse out
> "Mathematical proof that 5 is greater than 3!"
>
> but it's only broken code, not life and death.
I am basically looking for links and revisions.
But if I had to deal with
<body>
AT&T
</body>
I'd probably do a
$ raku
Welcome to 𝐑𝐚𝐤𝐮𝐝𝐨™ v2021.07.
Implementing the 𝐑𝐚𝐤𝐮™ programming language v6.d.
Built on MoarVM version 2021.07.
To exit type 'exit' or '^D'
> my $x = Q[AT&T];
AT&T
> $x~~s/ ('AT&T') /AT&T/;
｢AT&T｣
0 => ｢AT&T｣
> say $x
AT&T
Revisions and link never have odd characters in them.
It is far easier for me to just go straight to the
code itself than trying translating it to text. Keep
in mind that I know the pattern I am looking for and
the rest of the page is just noise to be discarded.
My biggest difficultly is having to go into
hexedit to find unprintable characters, but I
have gotten pretty good at figuring out when
that is happening and working around them. This
usually happens when a web designer mixes UTF-8
and UTF-16 together by accident. I am in UTF-8.
Date: Tue, 12 Oct 2021 03:45:06 -0700
On 10/12/21 03:04, Hans Henrik Bergan via curl-users wrote:
> ry digging this company name out of the HTML:
> <span>AT&T</span>
>
> the correct translation, as a proper HTML parser will get you: AT&T
> what a regex extraction will get you: AT&T
> try digging the title out of this link:
> <a href="foo" title="5>3"> Mathematical proof that 5 is greater than 3! </a>
>
> a regex extraction is very likely to fail here, and extract 3">
> Mathematical(...)
> while a proper HTML parser will have no problem, and correctly parse out
> "Mathematical proof that 5 is greater than 3!"
>
> but it's only broken code, not life and death.
I am basically looking for links and revisions.
But if I had to deal with
<body>
AT&T
</body>
I'd probably do a
$ raku
Welcome to 𝐑𝐚𝐤𝐮𝐝𝐨™ v2021.07.
Implementing the 𝐑𝐚𝐤𝐮™ programming language v6.d.
Built on MoarVM version 2021.07.
To exit type 'exit' or '^D'
> my $x = Q[AT&T];
AT&T
> $x~~s/ ('AT&T') /AT&T/;
｢AT&T｣
0 => ｢AT&T｣
> say $x
AT&T
Revisions and link never have odd characters in them.
It is far easier for me to just go straight to the
code itself than trying translating it to text. Keep
in mind that I know the pattern I am looking for and
the rest of the page is just noise to be discarded.
My biggest difficultly is having to go into
hexedit to find unprintable characters, but I
have gotten pretty good at figuring out when
that is happening and working around them. This
usually happens when a web designer mixes UTF-8
and UTF-16 together by accident. I am in UTF-8.
-- Unsubscribe: https://lists.haxx.se/listinfo/curl-users Etiquette: https://curl.haxx.se/mail/etiquette.htmlReceived on 2021-10-12