I need to download an html report from a website using cURL. I have had great success uploading files using cURL, but have not downloaded before.
The webmaster at the site I am trying to download from has given me a direct URL link to pull the report into a browser as shown below (uid and pw's *** out):
https://web1.ncaa.org/compliance/exec/adhocrunner?&orgId=*********&orgPassword=********&userId=*********&userPassword=*********&reportId=6397.0
The above link works perfectly when pasted into a browser. However, I when I run the command below from a Unix command line, I get an "Invalid OrgID and OrgPassword" message in the output file. Yes, the id's and pw's are exactly the same as the ones that work in the browser.
curl -o outputfilename https://web1.ncaa/etc....(line above)
I have been told by our resident web specialist that this could be a cookies issue, so I looked through the history of problems on the cURL web site for solutions. I can successfully capture the cookies using the -c --cookie jar. I have then tried to put the cookies back up to the server by calling cURL again using -b cookies.
I guess I'm missing something because I am still getting invalid org id and password in the output file as a result of issuing the commands below:
curl -s -S -L -c cookiefile https://web1.ncaa.org/compliance/exec/adhocrunner?&orgId=*********&orgPassword=********&userId=*********&userPassword=*********&reportId=6397.0 (cookies are written to the file)
curl -s -S -L -b cookiefile -o outputfilename https://web1.ncaa.org/compliance/exec/adhocrunner?&orgId=*********&orgPassword=********&userId=*********&userPassword=*********&reportId=6397.0
I copied the above from a previous solution from this site. Am I missing something? Are there instances where cURL will not work based upon the server configuration on the other end? Help!!!
Lori Bonatakis
University of CT
Received on 2004-12-27