[MLB-WIRELESS] [Fwd: [Perth Wireless] Perth freenet search engine]

[James Healy]

Man... perth rocks....

James

-----Forwarded Message-----

> From: Marcus S <axis at ii.net>
> To: wireless at innaloo.net
> Subject: [Perth Wireless] Perth freenet search engine
> Date: 23 Sep 2002 07:55:51 +0000
> 
> In case you hadn't heard, the freenet now has a search engine - froogle.
> 
> http://planetaxis.hh.wafreenet/froogle/   (or http://10.60.0.46/froogle 
> for the DNS impaired)
> 
> Comments and feedback are more than welcome.
> 
> Cheers, Marcus
> 
> 
> TECH STUFF
> This uses the "ht://dig" engine, along with some custom crawling scripts 
> to index known sites on the perth freenet.  Indexing is currently 
> scheduled once a week overnight to avoid disruptive traffic.
> 
> Essentially, i ping scan the set of known connected freenet C class 
> networks (as listed at http://www.wafreenet.org/?page=network ), then port 
> 80 scan the visible PC's to find web servers.
> 
> Once the visible web servers are known, ht://dig then spiders from those 
> servers to a (current) depth of two links.
> 
> 
> IF YOU WANT TO BE INDEXED
> * Just make your server visible on the greater freenet and my script 
> should find it.  If not, email me and i'll add you in manually.
> 
> 
> IF YOU DONT WANT TO BE INDEXED
> * Use the robots.txt to tell ht://dig to go away
> * Email me and i'll add you to a list of exclusions.
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
-- 
******************************************************
"Before you criticise someone, you should walk a mile in their shoes.
That way, when you criticise them, you're a mile away and you have their
shoes. "

work: worker at aycs.org.au / personal: jimmy at deefa.com
msn: jimmy at deefa.com / ICQ: 6370237
web: www.deefa.com
******************************************************


To unsubscribe: send mail to majordomo at wireless.org.au
with "unsubscribe melbwireless" in the body of the message