curl-users
Re: Question about Curl.
From: Linus Nielsen Feltzing <linus_at_haxx.se>
Date: Fri, 05 Sep 2003 00:33:31 +0200
Date: Fri, 05 Sep 2003 00:33:31 +0200
pjshome_at_btinternet.com wrote:
> I tried curl on google not expecting any success and it didn't work.
>
> There are a million ways a web site can work out whether it is
> responding to a browser or just a scraper and I bet google is seldom
> fooled.
Google uses the Agent string, so all we need to do is to use an agent
string that Google likes:
curl -A "Mozilla/5.001 (windows; U; NT4.0; en-us) Gecko/25250101"
"http://www.google.com/search?hl=es&ie=ISO-8859-1&q=calidad+de+software&btnG=B%FAsqueda+en+Google&lr
="
Linus
-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
Received on 2003-09-05