cURL / Mailing Lists / curl-users / Single Mail

curl-users

Trouble Authenticating to a CAS service with curl

From: Erin M Campbell <erinc_at_us.ibm.com>
Date: Thu, 12 Jan 2012 12:47:00 -0500

Hi All -
I am new to Curl. But I am trying to use it to do the following simple
task:

1) Go to a website page and get the latest zip files to download (which are
urls) from that page ( so we can automate updates to the files)
2) The Website will prompt you to go to a login paget to Authenticate
3) Perform download

I have also tried

1) Go to website and logon
2) Go to page and get the latest download urls for zip files

The site is using CAS Authentication. The problem occurs when doing the
authentication. I do have save cookie- jar set for this website. However
the problem is the CAS server is supposed to be returning an ST and TGC
tokens as well as MOD_AUTH_CAS cookies back.

However thru curl - I am never getting those cookies back - so saving them
and reloading them is not working.....Instead the only cookie I see being
saved is the JSESSION ID.  I keep constantly getting a redirection page for
the login page. (I do also have Location turned on to hopefully handle
redirects)

I have tried very hard to enter all the correct form fields that I see
being used by my browser - but despite all my tries it continues to fail.

Here is my curl command to simply do the login and get the cookies:

C:\curl-7.23.1-ssl-sspi-zlib-static-bin-w32>curl -k --data
"username=philipparke
r&password=passw0rd1A<=e1s1&_eventId=submit&submit_Sign%20In" -i -b
cookieJar -c
 cookieJar
https://utslogin.nlm.nih.gov/cas/login?service=https%3A%2F%2Futs.nlm.
nih.gov%3A443%2F%2Fj_spring_cas_security_check -D headers -v -referer
https://ut
slogin.nlm.nih.gov/cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_
spring_cas_security_check -user-agent="Mozilla/5.0 (Windows; U; Windows NT
5.1;
en-US; rv:1.9.2.25) Gecko/20111212 Firefox/3.6.25" -L

Here is what the contents of the cookieJar file

 Netscape HTTP Cookie File
# http://curl.haxx.se/rfc/cookie_spec.html
# This file was generated by libcurl! Edit at your own risk.

utslogin.nlm.nih.gov FALSE /cas TRUE 0 JSESSIONID
ZVJok8UhD8EQ3yF7IrS9.1

Here is what is in my headers file I am dumping:

HTTP/1.1 200 OK
Server: Apache-Coyote/1.1
Pragma: no-cache
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Cache-Control: no-cache
Cache-Control: no-store
Set-Cookie: JSESSIONID=ZVJok8UhD8EQ3yF7IrS9.1; Path=/cas; Secure
Content-Type: text/html;charset=UTF-8
Transfer-Encoding: chunked
Date: Thu, 12 Jan 2012 00:38:47 GMT
X-VIP-Info: 130.14.16.164:443
X-Pool-Info: utslogin_p 10.1.5.14 8080

HTTP/1.1 200 OK
Server: Apache-Coyote/1.1
Pragma: no-cache
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Cache-Control: no-cache
Cache-Control: no-store
Content-Type: text/html;charset=UTF-8
Transfer-Encoding: chunked
Date: Thu, 12 Jan 2012 00:38:47 GMT
X-VIP-Info: 130.14.16.164:443
X-Pool-Info: utslogin_p 10.1.5.14 8080

Here is the output from LiveHeaders of the manual mozilla authentication
process. As you can see I never get back some of the required cookies.

POST /cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check
 HTTP/1.1
Host: utslogin.nlm.nih.gov
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.25)
Gecko/20111212 Firefox/3.6.25
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Referer:
https://utslogin.nlm.nih.gov/cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check

Cookie: JSESSIONID=5gTeFluq4RG3HarkKcX3.1;
CASTGC=TGT-151977-lqgYelMsZMX5qgAnMjZaqIUwUbHDNRBoD2G99CjrtXaZaVdRTf-cas;
ncbi_sid=396B3F2AE5E7A5E1_0084SID; fsr.r.nlm=
{"d":90,"i":"1326131102742_691370","e":1326736100916}; fsr.s.nlm=
{"v":1,"rid":"1326131102742_691370","ru":"http://www.google.com/url?sa=t&rct=j&q=automatically%20download%20from%20umls&source=web&cd=2&ved=0CCMQFjAB&url=http%3A%2F%2Fwww.nlm.nih.gov%2Fresearch%2Fumls%2Flicensedcontent%2Fumlsknowledgesources.html&ei=kycLT4bTNuPZmAWdsNQn&usg=AFQjCNEnYk-yfYL3gL5ebq2O0BqJEJV5Ug","r":"www.google.com","st":"automatically
 download from
umls","cp":{"delivery_src":"none"},"to":5,"c":"http://www.nlm.nih.gov/research/umls/licensedcontent/snomedctfiles.html","pv":50,"lc":{"d1":{"v":50,"s":true}},"cd":1,"sd":1,"f":1326292600497,"i":-1,"l":"en"};
 SRA_SESSION=3AB4ECEE9CCDA5BC881BDFC17844208E8C11C169
Content-Type: application/x-www-form-urlencoded
Content-Length: 80
username=ymUser&password=myPass&lt=e2s1&_eventId=submit&submit=Sign+In
HTTP/1.1 302 Moved Temporarily
Server: Apache-Coyote/1.1
Pragma: no-cache
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Cache-Control: no-cache, no-store
Set-Cookie: JSESSIONID=0F30qaXrk2tB4KfoAaSu.1; Path=/cas; Secure
Location:
https://utslogin.nlm.nih.gov/cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check

Content-Length: 0
Date: Thu, 12 Jan 2012 14:22:37 GMT
X-VIP-Info: 130.14.16.164:443
X-Pool-Info: utslogin_p 10.1.5.14 8080
----------------------------------------------------------
https://utslogin.nlm.nih.gov/cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check

GET /cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check
 HTTP/1.1
Host: utslogin.nlm.nih.gov
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.25)
Gecko/20111212 Firefox/3.6.25
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Referer:
https://utslogin.nlm.nih.gov/cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check

Cookie: JSESSIONID=0F30qaXrk2tB4KfoAaSu.1;
CASTGC=TGT-151977-lqgYelMsZMX5qgAnMjZaqIUwUbHDNRBoD2G99CjrtXaZaVdRTf-cas;
ncbi_sid=396B3F2AE5E7A5E1_0084SID; fsr.r.nlm=
{"d":90,"i":"1326131102742_691370","e":1326736100916}; fsr.s.nlm=
{"v":1,"rid":"1326131102742_691370","ru":"http://www.google.com/url?sa=t&rct=j&q=automatically%20download%20from%20umls&source=web&cd=2&ved=0CCMQFjAB&url=http%3A%2F%2Fwww.nlm.nih.gov%2Fresearch%2Fumls%2Flicensedcontent%2Fumlsknowledgesources.html&ei=kycLT4bTNuPZmAWdsNQn&usg=AFQjCNEnYk-yfYL3gL5ebq2O0BqJEJV5Ug","r":"www.google.com","st":"automatically
 download from
umls","cp":{"delivery_src":"none"},"to":5,"c":"http://www.nlm.nih.gov/research/umls/licensedcontent/snomedctfiles.html","pv":50,"lc":{"d1":{"v":50,"s":true}},"cd":1,"sd":1,"f":1326292600497,"i":-1,"l":"en"};
 SRA_SESSION=3AB4ECEE9CCDA5BC881BDFC17844208E8C11C169

HTTP/1.1 200 OK
Server: Apache-Coyote/1.1
Pragma: no-cache
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Cache-Control: no-cache, no-store
Content-Type: text/html;charset=UTF-8
Transfer-Encoding: chunked
Date: Thu, 12 Jan 2012 14:22:37 GMT
X-VIP-Info: 130.14.16.164:443
X-Pool-Info: utslogin_p 10.1.5.14 8080
----------------------------------------------------------
https://utslogin.nlm.nih.gov/cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check

POST /cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check
 HTTP/1.1
Host: utslogin.nlm.nih.gov
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.25)
Gecko/20111212 Firefox/3.6.25
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Referer:
https://utslogin.nlm.nih.gov/cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check

Cookie: JSESSIONID=0F30qaXrk2tB4KfoAaSu.1;
CASTGC=TGT-151977-lqgYelMsZMX5qgAnMjZaqIUwUbHDNRBoD2G99CjrtXaZaVdRTf-cas;
ncbi_sid=396B3F2AE5E7A5E1_0084SID; fsr.r.nlm=
{"d":90,"i":"1326131102742_691370","e":1326736100916}; fsr.s.nlm=
{"v":1,"rid":"1326131102742_691370","ru":"http://www.google.com/url?sa=t&rct=j&q=automatically%20download%20from%20umls&source=web&cd=2&ved=0CCMQFjAB&url=http%3A%2F%2Fwww.nlm.nih.gov%2Fresearch%2Fumls%2Flicensedcontent%2Fumlsknowledgesources.html&ei=kycLT4bTNuPZmAWdsNQn&usg=AFQjCNEnYk-yfYL3gL5ebq2O0BqJEJV5Ug","r":"www.google.com","st":"automatically
 download from
umls","cp":{"delivery_src":"none"},"to":5,"c":"http://www.nlm.nih.gov/research/umls/licensedcontent/snomedctfiles.html","pv":50,"lc":{"d1":{"v":50,"s":true}},"cd":1,"sd":1,"f":1326292600497,"i":-1,"l":"en"};
 SRA_SESSION=3AB4ECEE9CCDA5BC881BDFC17844208E8C11C169
Content-Type: application/x-www-form-urlencoded
Content-Length: 80
username=myUser&password=myPass=e1s1&_eventId=submit&submit=Sign+In
HTTP/1.1 302 Moved Temporarily
Server: Apache-Coyote/1.1
Pragma: no-cache
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Cache-Control: no-cache, no-store
Set-Cookie: JSESSIONID=0F30qaXrk2tB4KfoAaSu.0; Path=/cas; Secure
Set-Cookie: CASPRIVACY=""; Expires=Thu, 01-Jan-1970 00:00:10 GMT; Path=/cas
Set-Cookie:
CASTGC=TGT-29831-5jgZCEGGqNgBXlb9Kd6fueFVdsQUrdpbWqgbJIRpiHTHpvipgK-cas;
Path=/cas; Secure
Location:
https://uts.nlm.nih.gov:443//j_spring_cas_security_check?ticket=ST-104806-qngJTTffc4xWFf7FRdz4-cas

Content-Length: 0
Date: Thu, 12 Jan 2012 14:23:23 GMT
X-VIP-Info: 130.14.16.164:443
X-Pool-Info: utslogin_p 10.1.5.13 8080
----------------------------------------------------------
http://ocsp.entrust.net/

POST / HTTP/1.1
Host: ocsp.entrust.net
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.25)
Gecko/20111212 Firefox/3.6.25
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Content-Length: 103
Content-Type: application/ocsp-request
0e0c0A0?0=0    +
HTTP/1.0 200 OK
Content-Type: application/ocsp-response
Content-Transfer-Encoding: Binary
Content-Length: 1939
Connection: Close
----------------------------------------------------------
https://uts.nlm.nih.gov//j_spring_cas_security_check?ticket=ST-104806-qngJTTffc4xWFf7FRdz4-cas

GET //j_spring_cas_security_check?ticket=ST-104806-qngJTTffc4xWFf7FRdz4-cas
HTTP/1.1
Host: uts.nlm.nih.gov
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.25)
Gecko/20111212 Firefox/3.6.25
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Referer:
https://utslogin.nlm.nih.gov/cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check

Cookie: ncbi_sid=396B3F2AE5E7A5E1_0084SID; fsr.r.nlm=
{"d":90,"i":"1326131102742_691370","e":1326736100916}; fsr.s.nlm=
{"v":1,"rid":"1326131102742_691370","ru":"http://www.google.com/url?sa=t&rct=j&q=automatically%20download%20from%20umls&source=web&cd=2&ved=0CCMQFjAB&url=http%3A%2F%2Fwww.nlm.nih.gov%2Fresearch%2Fumls%2Flicensedcontent%2Fumlsknowledgesources.html&ei=kycLT4bTNuPZmAWdsNQn&usg=AFQjCNEnYk-yfYL3gL5ebq2O0BqJEJV5Ug","r":"www.google.com","st":"automatically
 download from
umls","cp":{"delivery_src":"none"},"to":5,"c":"http://www.nlm.nih.gov/research/umls/licensedcontent/snomedctfiles.html","pv":50,"lc":{"d1":{"v":50,"s":true}},"cd":1,"sd":1,"f":1326292600497,"i":-1,"l":"en"};
 SRA_SESSION=3AB4ECEE9CCDA5BC881BDFC17844208E8C11C169;
JSESSIONID=SLEpCWYAXIs2mYouTo2p.18

HTTP/1.1 302 Moved Temporarily
Server: Apache-Coyote/1.1
Set-Cookie: JSESSIONID=vhdyDQg3E1Vr0CHmtVBn.12; Path=/; Secure
Location: https://uts.nlm.nih.gov:443/home.html
Content-Length: 0
Date: Thu, 12 Jan 2012 14:23:24 GMT
X-VIP-Info: 130.14.16.163:443
X-Pool-Info: uts_p 10.1.5.1 8080
----------------------------------------------------------
https://uts.nlm.nih.gov/home.html

GET /home.html HTTP/1.1
Host: uts.nlm.nih.gov
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.25)
Gecko/20111212 Firefox/3.6.25
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Referer:
https://utslogin.nlm.nih.gov/cas/login?service=https%3A%2F%2Futs.nlm.nih.gov%3A443%2F%2Fj_spring_cas_security_check

Cookie: ncbi_sid=396B3F2AE5E7A5E1_0084SID; fsr.r.nlm=
{"d":90,"i":"1326131102742_691370","e":1326736100916}; fsr.s.nlm=
{"v":1,"rid":"1326131102742_691370","ru":"http://www.google.com/url?sa=t&rct=j&q=automatically%20download%20from%20umls&source=web&cd=2&ved=0CCMQFjAB&url=http%3A%2F%2Fwww.nlm.nih.gov%2Fresearch%2Fumls%2Flicensedcontent%2Fumlsknowledgesources.html&ei=kycLT4bTNuPZmAWdsNQn&usg=AFQjCNEnYk-yfYL3gL5ebq2O0BqJEJV5Ug","r":"www.google.com","st":"automatically
 download from
umls","cp":{"delivery_src":"none"},"to":5,"c":"http://www.nlm.nih.gov/research/umls/licensedcontent/snomedctfiles.html","pv":50,"lc":{"d1":{"v":50,"s":true}},"cd":1,"sd":1,"f":1326292600497,"i":-1,"l":"en"};
 SRA_SESSION=3AB4ECEE9CCDA5BC881BDFC17844208E8C11C169;
JSESSIONID=vhdyDQg3E1Vr0CHmtVBn.12
If-Modified-Since: Thu, 22 Dec 2011 13:48:21 GMT
If-None-Match: W/"3134-1324561701000"

HTTP/1.1 200 OK
Server: Apache-Coyote/1.1
Cache-Control: no-cache
Pragma: no-cache
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Accept-Ranges: bytes
Etag: W/"3134-1323901106000"
Last-Modified: Wed, 14 Dec 2011 22:18:26 GMT
Content-Type: text/html
Content-Length: 3134
Date: Thu, 12 Jan 2012 14:23:24 GMT
X-VIP-Info: 130.14.16.163:443
X-Pool-Info: uts_p 10.1.5.1 8080
----------------------------------------------------------
https://uts.nlm.nih.gov/home/commonService

POST /home/commonService HTTP/1.1
Host: uts.nlm.nih.gov
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.25)
Gecko/20111212 Firefox/3.6.25
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Content-Type: text/x-gwt-rpc; charset=utf-8
X-GWT-Permutation: 5BF050C45AEBAE5F3E95E2DCACFC247E
X-GWT-Module-Base: https://uts.nlm.nih.gov/home/
Referer:
https://uts.nlm.nih.gov/home/5BF050C45AEBAE5F3E95E2DCACFC247E.cache.html
Content-Length: 167
Cookie: ncbi_sid=396B3F2AE5E7A5E1_0084SID; fsr.r.nlm=
{"d":90,"i":"1326131102742_691370","e":1326736100916}; fsr.s.nlm=
{"v":1,"rid":"1326131102742_691370","ru":"http://www.google.com/url?sa=t&rct=j&q=automatically%20download%20from%20umls&source=web&cd=2&ved=0CCMQFjAB&url=http%3A%2F%2Fwww.nlm.nih.gov%2Fresearch%2Fumls%2Flicensedcontent%2Fumlsknowledgesources.html&ei=kycLT4bTNuPZmAWdsNQn&usg=AFQjCNEnYk-yfYL3gL5ebq2O0BqJEJV5Ug","r":"www.google.com","st":"automatically
 download from
umls","cp":{"delivery_src":"none"},"to":5,"c":"http://www.nlm.nih.gov/research/umls/licensedcontent/snomedctfiles.html","pv":50,"lc":{"d1":{"v":50,"s":true}},"cd":1,"sd":1,"f":1326292600497,"i":-1,"l":"en"};
 SRA_SESSION=3AB4ECEE9CCDA5BC881BDFC17844208E8C11C169;
JSESSIONID=vhdyDQg3E1Vr0CHmtVBn.12
Pragma: no-cache
Cache-Control: no-cache
6|0|4|https://uts.nlm.nih.gov/home/|E3E88EBD195E07844A593B243ADEE180|
gov.nih.nlm.umls.uts.web.gwt.common.client.services.CommonService|
getInitializationData|1|2|3|4|0|
HTTP/1.1 200 OK
Server: Apache-Coyote/1.1
Content-Encoding: gzip
Content-Disposition: attachment
Content-Type: application/json;charset=utf-8
Content-Length: 6832
Date: Thu, 12 Jan 2012 14:23:28 GMT
X-VIP-Info: 130.14.16.163:443
X-Pool-Info: uts_p 10.1.5.1 8080
----------------------------------------------------------
https://uts.nlm.nih.gov/home/commonService

POST /home/commonService HTTP/1.1
Host: uts.nlm.nih.gov
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.25)
Gecko/20111212 Firefox/3.6.25
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Content-Type: text/x-gwt-rpc; charset=utf-8
X-GWT-Permutation: 5BF050C45AEBAE5F3E95E2DCACFC247E
X-GWT-Module-Base: https://uts.nlm.nih.gov/home/
Referer:
https://uts.nlm.nih.gov/home/5BF050C45AEBAE5F3E95E2DCACFC247E.cache.html
Content-Length: 162
Cookie: ncbi_sid=396B3F2AE5E7A5E1_0084SID; fsr.r.nlm=
{"d":90,"i":"1326131102742_691370","e":1326736100916}; fsr.s.nlm=
{"v":1,"rid":"1326131102742_691370","ru":"http://www.google.com/url?sa=t&rct=j&q=automatically%20download%20from%20umls&source=web&cd=2&ved=0CCMQFjAB&url=http%3A%2F%2Fwww.nlm.nih.gov%2Fresearch%2Fumls%2Flicensedcontent%2Fumlsknowledgesources.html&ei=kycLT4bTNuPZmAWdsNQn&usg=AFQjCNEnYk-yfYL3gL5ebq2O0BqJEJV5Ug","r":"www.google.com","st":"automatically
 download from
umls","cp":{"delivery_src":"none"},"to":5,"c":"http://www.nlm.nih.gov/research/umls/licensedcontent/snomedctfiles.html","pv":50,"lc":{"d1":{"v":50,"s":true}},"cd":1,"sd":1,"f":1326292600497,"i":-1,"l":"en"};
 SRA_SESSION=3AB4ECEE9CCDA5BC881BDFC17844208E8C11C169;
JSESSIONID=vhdyDQg3E1Vr0CHmtVBn.12
Pragma: no-cache
Cache-Control: no-cache
6|0|4|https://uts.nlm.nih.gov/home/|E3E88EBD195E07844A593B243ADEE180|
gov.nih.nlm.umls.uts.web.gwt.common.client.services.CommonService|
getHeaderContent|1|2|3|4|0|
HTTP/1.1 200 OK
Server: Apache-Coyote/1.1
Content-Encoding: gzip
Content-Disposition: attachment
Content-Type: application/json;charset=utf-8
Content-Length: 4376
Date: Thu, 12 Jan 2012 14:23:29 GMT
X-VIP-Info: 130.14.16.163:443
X-Pool-Info: uts_p 10.1.5.1 8080
----------------------------------------------------------
https://uts.nlm.nih.gov/doc/frontpage/homepage.html

GET /doc/frontpage/homepage.html HTTP/1.1
Host: uts.nlm.nih.gov
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.25)
Gecko/20111212 Firefox/3.6.25
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Cache-Control: no-cache
Referer:
https://uts.nlm.nih.gov/home/5BF050C45AEBAE5F3E95E2DCACFC247E.cache.html
Cookie: ncbi_sid=396B3F2AE5E7A5E1_0084SID; fsr.r.nlm=
{"d":90,"i":"1326131102742_691370","e":1326736100916}; fsr.s.nlm=
{"v":1,"rid":"1326131102742_691370","ru":"http://www.google.com/url?sa=t&rct=j&q=automatically%20download%20from%20umls&source=web&cd=2&ved=0CCMQFjAB&url=http%3A%2F%2Fwww.nlm.nih.gov%2Fresearch%2Fumls%2Flicensedcontent%2Fumlsknowledgesources.html&ei=kycLT4bTNuPZmAWdsNQn&usg=AFQjCNEnYk-yfYL3gL5ebq2O0BqJEJV5Ug","r":"www.google.com","st":"automatically
 download from
umls","cp":{"delivery_src":"none"},"to":5,"c":"http://www.nlm.nih.gov/research/umls/licensedcontent/snomedctfiles.html","pv":50,"lc":{"d1":{"v":50,"s":true}},"cd":1,"sd":1,"f":1326292600497,"i":-1,"l":"en"};
 SRA_SESSION=3AB4ECEE9CCDA5BC881BDFC17844208E8C11C169;
JSESSIONID=vhdyDQg3E1Vr0CHmtVBn.12
If-Modified-Since: Thu, 22 Dec 2011 20:46:23 GMT
If-None-Match: W/"8675-1324586783000"

HTTP/1.1 200 OK
Server: Apache-Coyote/1.1
Cache-Control: no-cache
Pragma: no-cache
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Set-Cookie: JSESSIONID=vhdyDQg3E1Vr0CHmtVBn.18; Path=/; Secure
Accept-Ranges: bytes
Etag: W/"8675-1324561701000"
Last-Modified: Thu, 22 Dec 2011 13:48:21 GMT
Content-Type: text/html
Content-Length: 8675
Date: Thu, 12 Jan 2012 14:23:29 GMT
X-VIP-Info: 130.14.16.163:443
X-Pool-Info: uts_p 10.1.5.2 8080
----------------------------------------------------------
https://uts.nlm.nih.gov/home/commonService

POST /home/commonService HTTP/1.1
Host: uts.nlm.nih.gov
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.25)
Gecko/20111212 Firefox/3.6.25
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Content-Type: text/x-gwt-rpc; charset=utf-8
X-GWT-Permutation: 5BF050C45AEBAE5F3E95E2DCACFC247E
X-GWT-Module-Base: https://uts.nlm.nih.gov/home/
Referer:
https://uts.nlm.nih.gov/home/5BF050C45AEBAE5F3E95E2DCACFC247E.cache.html
Content-Length: 162
Cookie: ncbi_sid=396B3F2AE5E7A5E1_0084SID; fsr.r.nlm=
{"d":90,"i":"1326131102742_691370","e":1326736100916}; fsr.s.nlm=
{"v":1,"rid":"1326131102742_691370","ru":"http://www.google.com/url?sa=t&rct=j&q=automatically%20download%20from%20umls&source=web&cd=2&ved=0CCMQFjAB&url=http%3A%2F%2Fwww.nlm.nih.gov%2Fresearch%2Fumls%2Flicensedcontent%2Fumlsknowledgesources.html&ei=kycLT4bTNuPZmAWdsNQn&usg=AFQjCNEnYk-yfYL3gL5ebq2O0BqJEJV5Ug","r":"www.google.com","st":"automatically
 download from
umls","cp":{"delivery_src":"none"},"to":5,"c":"http://www.nlm.nih.gov/research/umls/licensedcontent/snomedctfiles.html","pv":50,"lc":{"d1":{"v":50,"s":true}},"cd":1,"sd":1,"f":1326292600497,"i":-1,"l":"en"};
 SRA_SESSION=3AB4ECEE9CCDA5BC881BDFC17844208E8C11C169;
JSESSIONID=vhdyDQg3E1Vr0CHmtVBn.12
Pragma: no-cache
Cache-Control: no-cache
6|0|4|https://uts.nlm.nih.gov/home/|E3E88EBD195E07844A593B243ADEE180|
gov.nih.nlm.umls.uts.web.gwt.common.client.services.CommonService|
getHeaderContent|1|2|3|4|0|
HTTP/1.1 200 OK
Server: Apache-Coyote/1.1
Set-Cookie: JSESSIONID=vhdyDQg3E1Vr0CHmtVBn.21; Path=/; Secure
Content-Encoding: gzip
Content-Disposition: attachment
Content-Type: application/json;charset=utf-8
Content-Length: 4376
Date: Thu, 12 Jan 2012 14:23:29 GMT
X-VIP-Info: 130.14.16.163:443

HELP - ANY IDEAS WOULD BE APPRECIATED  !!
(Please note , I did try user agent, referer, and I have copied exact post
data from Live Headers - all to no avail)

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ: http://curl.haxx.se/docs/faq.html
Etiquette: http://curl.haxx.se/mail/etiquette.html
Received on 2012-01-12