curl-users
Re: help to download web pages
Date: Tue, 16 Dec 2003 22:43:04 +0100 (CET)
On Tue, 16 Dec 2003, Peter Ping wrote:
> Tried to download a web page via curl and was not successful. Viewed
> downloaded source code and found "This web page uses frames, but your
> browser doesn't support them." even I already specified that "in-frame"
> page. Could you please help me how to solve the problem?
Try to identify yourself as a browser:
curl -A "Mozilla/3.0 (Win95; I)" http://www.framesite.net/page.html
I've used this technique sometime myself, but I also used it for hiding that
I'm curling pages (some webmaster don't like when you sniff their contents).
// Kjell
-------------------------------------------------------
This SF.net email is sponsored by: IBM Linux Tutorials.
Become an expert in LINUX or just sharpen your skills. Sign up for IBM's
Free Linux Tutorials. Learn everything from the bash shell to sys admin.
Click now! http://ads.osdn.com/?ad_id=1278&alloc_id=3371&op=click
Received on 2003-12-17