New Yahoo Search Crawler Release
Tuesday, August 1st, 2006As Yahoo says in the search blog they released a new web crawler (Slurp) on July 28 which should be more efficient in crawling websites and thus reduce the number of requests by about 25%. This should result in using less bandwidth consumed by the crawler. Also we can expect some changes in the way [...]
