curl-users
curl.haxx.se crawl map
Date: Sun, 04 Aug 2013 16:54:37 +0200
Just a FYI.
I just installed YaCy (one of the more impressive Java application I
have seen). YaCy is a project that offers fully decentralized peer-to-peer search.
Something like Tor, but only for web-searches. Ref.
http://www.yacy.net/en/index.html
While running this Java-app here, I did a web-crawl of http://curl.haxx.se.
The resulting picture (the 1st crawl level) is attached. A more detailed
picture is here:
http://home.broadpark.no/~gvanem/misc/curl-WebStructurePicture2.png
curl.haxx.se surely has many external links.
--gv
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ: http://curl.haxx.se/docs/faq.html
Etiquette: http://curl.haxx.se/mail/etiquette.html