curl-users
Max Get Limit
From: Tom Kucera <Thomas_Kucera_at_brown.edu>
Date: Sun, 24 Dec 2000 15:09:30 -0500
Date: Sun, 24 Dec 2000 15:09:30 -0500
Is there a max. amount of data that curl will return? I'm using the below
code to extract web pages, but for this one page it never returns all of the
data. It stops returning near the bottom. Every time I run it, it stops in a
different place. However curl says that it succesfully completed even though
a couple of lines from the page are missing.
$command = "$curl \"$url\" $param -v -S -i -A \"Mozilla/4.0\" -o
\"file.txt\" $thegoods";
my @output = `$command`;
I then print out @output.
Thoughts?
Thanks,
Tom
Received on 2000-12-24