Class: ApplicationSpider

Inherits:
Kimurai::Base show all
Includes:
ApplicationHelper
Defined in:
lib/kimurai/template/spiders/application_spider.rb

Overview

ApplicationSpider is a default base spider class. You can set here default settings for all spiders inherited from ApplicationSpider. To generate a new spider, run: ‘$ kimurai generate spider spider_name`

Constant Summary

Constants inherited from Kimurai::Base

Kimurai::Base::DMERGE_EXCLUDE, Kimurai::Base::LoggerFormatter

Instance Attribute Summary

Attributes inherited from Kimurai::Base

#logger, #with_info

Method Summary

Methods inherited from Kimurai::Base

#add_event, add_event, #browser, completed?, config, #console, crawl!, engine, failed?, #initialize, items, logger, name, parse!, pipelines, #request_to, running?, #save_to, start_urls, #storage, #unique?, update, visits

Constructor Details

This class inherits a constructor from Kimurai::Base