Weivel Search spider

Before Dawn Solutions, is in the process of launching a new kind of search engine/portal.  As part of this process we have a spider called weivel that is out scouring the internet for interesting content. 
The weivel search spider is robots.txt friendly, so if you would like weivel to visit your site less often or not at all, then simply put it into the robots.txt file.  To get more information on robots.txt please go to http://www.robotstxt.org .  The Weivel spider is based on the Apache Nutch Open Source project to find more information about Apache Nutch, please go to http://lucene.apache.org/nutch/ .  If you have any additional comments/questions or would like to have your site added into our index, please don't hesitate to contact us at our contacts page located here .

Next >