On Mon September 21 2009 17:04:20 David Romano wrote:
> I want to dowload a small directory of .pdf documents using http, and a
> colleague suggested I use curl. From the man page and FAQ it seems that
> curl cannot get these recursivey (say, by asking for the parent directory
> and its contents), but I was hoping to at least use curl to recreate the
> directory structure locally using --create-dirs. The trouble is I can't
> seem to get the sytax correct. The directory structure is very simple:
>
> top directory
> www.pdf.org/subject
>
> children directories
> www.pdf.org/subject/amy
> www.pdf.org/subject/birgid
>
> where amy and birgid contain only pdf files, named according to content
> (no serially or sequentially).

AFAIK there is no such thing like "directory" defined by the http protocol.

> Any help suggestions would be greatly apreciated!

You can try to follow links between HTML pages instead. I downloaded a perl
script which I hope does exactly this, though not tested it myself yet:

http://curl.haxx.se/programs/curlmirror.txt

Kamil
-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ: http://curl.haxx.se/docs/faq.html
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2009-09-21