cURL / Mailing Lists / curl-users / Single Mail

curl-users

Re: Using curl to get files matching a pattern

From: Dan Fandrich <dan_at_coneharvesters.com>
Date: Tue, 24 Mar 2009 23:10:15 -0600

On Tue, Mar 24, 2009 at 11:29:59PM +0000, R B wrote:
> I have installed curl_7.18.2 for windows and AIX.
> I need to use curl to get files matching a pattern (Like all files ending with
> pattern *YYYYMMDD.xls ) from a https URL .
> Can curl do that ?

You can use the {} syntax to download a set of files using curl. curl doesn't
parse HTML, so if you need to do that in order to get a list of files to
download, you'll need to use a script to prepare a list for curl.

> Hope it does or there is a workaround .If curl doesn't do this , is there
> another command line tool for transferring files I can use ?

wget does HTML parsing, which might be more what you're looking for.

>>> Dan

-- 
http://www.MoveAnnouncer.com              The web change of address service
          Let webmasters know that your web site has moved
-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html
Received on 2009-03-25