cURL / Mailing Lists / curl-users / Single Mail

curl-users

Re: NYtimes.com - trying to save to file, but nothing returns

From: Brian Dessent <brian_at_dessent.net>
Date: Mon, 26 Nov 2007 21:06:53 -0800

Dan Fandrich wrote:

> > 0000: Location: http://www.nytimes.com/glogin?URI=http://www.nytimes.c
> > 0040: om/2007/11/25/sports/basketball/25dribble.html&OQ=_rQ3D1Q26exQ3D
> > 0080: 1353819600Q26enQ3D553ceb841f8eef32Q26eiQ3D5088Q26partnerQ3Drssny
> > 00c0: tQ26emcQ3Drss&OP=146640cbQ2F0Vgk0Q5EQ3EQ5CmJQ3EQ3ERl0l,,-0Q20Q20
> > 0100: 0l10mQ7EQ3EJRm0kLm8gRkLhh0l1Q5EJbkkhg.YRKh
>
> You're asking about FAQ 3.8:
> http://curl.haxx.se/docs/faq.html#How_do_I_tell_curl_to_follow_HTT

Even if you include -L it still probably won't work though. The
location it's redirecting to looks like a "you must first login to view
this" page, so you will either have to script that (painful!) or find a
URL for the page that works without any login credentials/cookies.
Since the nytimes recently tore down their pay wall I'm surprised you're
still running into this, but you might also try
<http://nytimes.blogspace.com/genlink>.

Brian
Received on 2007-11-27