SimpleCrawler - a web crawling library for Ruby

see www.peterkrantz.com/simplecrawler/wiki/ for more information