cURL / Mailing Lists / curl-users / Single Mail

curl-users

Re: Question about Curl.

From: Linus Nielsen Feltzing <linus_at_haxx.se>
Date: Fri, 05 Sep 2003 00:33:31 +0200

pjshome_at_btinternet.com wrote:

> I tried curl on google not expecting any success and it didn't work.
>
> There are a million ways a web site can work out whether it is
> responding to a browser or just a scraper and I bet google is seldom
> fooled.

Google uses the Agent string, so all we need to do is to use an agent
string that Google likes:

curl -A "Mozilla/5.001 (windows; U; NT4.0; en-us) Gecko/25250101"
"http://www.google.com/search?hl=es&ie=ISO-8859-1&q=calidad+de+software&btnG=B%FAsqueda+en+Google&lr
="

Linus

-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
Received on 2003-09-05