Hello Ralph,

Great ! Your information is very usefull. Thanks !!

A few more questions (to increase my knowlegde) :

- how did you know that cookies would make it work ?
- I cannot find any parameter in curl to convert the links in the document
to make them suitable for local viewing

Cheers, Jan

On 9/29/05, Ralph Mitchell <ralphmitchell_at_gmail.com> wrote:
>
> You need to process cookies. Something like:
>
> curl -b cookies -c cookies -o first_page.html [first_url]
> curl -b cookies -c cookies -o second_page.html [second_url]
>
> When I try that, I get back a page that contains, among other things:
>
> Vastgoedlijst
> 5 vastgoedaanbiedingen
>
> along with 5 images and prices in Euros. Displaying second_page.html in a
> browser gets me the same page as I get when I paste that first url into the
> browser.
>
> Ralph
>
>
> On 9/29/05, Jan Jansen <janjansenbe_at_gmail.com> wrote:
> >
> > Hi Ralph,
> >
> > When I try the following :
> >
> > curl "http://www.immoweb.be/NL/client/search.cfm?immosource=frnba&notid=92477&NotAlea=92477&Notcategorie&NotSearch=N"<http://www.immoweb.be/NL/client/search.cfm?immosource=frnba&notid=92477&NotAlea=92477&Notcategorie&NotSearch=N>
> >
> > and next
> >
> > curl -o test "http://www.immoweb.be/NL/client/results.gallery.cfm?xidcategorie=&mycurrent_section=buy&xinitliste=Y&xnotsearch=Y"<http://www.immoweb.be/NL/client/results.gallery.cfm?xidcategorie=&mycurrent_section=buy&xinitliste=Y&xnotsearch=Y>
> >
> > The content of test is totally different from when I just post the first
> > url in a webbrowser (which changes the url automatically in the second url)
> > and shows content in the browser. I am trying to fetch the source code of
> > that content.
> >
> > Jan
> >
> > On 9/29/05, Ralph Mitchell < ralphmitchell_at_gmail.com> wrote:
> > >
> > > Well, one thing you're going to have to do is take a look at the page
> > > you get back, and extract this line from it:
> > > location.href="results.gallery.cfm
> > > ?xidcategorie=&mycurrent_section=buy&xinitliste=Y&xnotsearch=Y"
> > >
> > > then fill in the fully qualified hostname and go fetch that. Another
> > > thing you might want to consider is taking wget questions to a mailing list
> > > that deals with wget. I believe this is the curl mailing list, though I can
> > > see how there might be some confusion...
> > >
> > > Ralph Mitchell
> > >
> > >
> > > On 9/29/05, Jan Jansen <janjansenbe_at_gmail.com > wrote:
> > > >
> > > > Hello,
> > > >
> > > > The basic functionality of wget is known to me and very usefull.
> > > >
> > > > However, currently I try to fetch a url of the following layout :
> > > >
> > > > http://www.immoweb.be/NL/client/search.cfm?immosource=frnba&notid=92477&NotAlea=92477&Notcategorie&NotSearch=N
> > > >
> > > >
> > > > which is automatically redirected towards the following url (when
> > > > pasting the first url in a browser)
> > > >
> > > > http://www.immoweb.be/NL/client/results.gallery.cfm?xidcategorie=&mycurrent_section=buy&xinitliste=Y&xnotsearch=Y
> > > >
> > > >
> > > > My question,
> > > >
> > > > how can I use the wget tool to fetch the source code, generated by
> > > > the automatically redirected url ?
> > > >
> > > > Greetz, Jan (janjansenbe_at_gmail.com)
> > > >
> > >
> > >
> >
>
Received on 2005-09-29