Class: ApplicationSpider

Inherits:
Tanakai::Base show all
Includes:
ApplicationHelper
Defined in:
lib/tanakai/template/spiders/application_spider.rb

Overview

ApplicationSpider is a default base spider class. You can set here default settings for all spiders inherited from ApplicationSpider. To generate a new spider, run: ‘$ tanakai generate spider spider_name`

Constant Summary

Constants inherited from Tanakai::Base

Tanakai::Base::DMERGE_EXCLUDE, Tanakai::Base::LoggerFormatter

Instance Attribute Summary

Attributes inherited from Tanakai::Base

#logger, #with_info

Method Summary

Methods inherited from Tanakai::Base

#add_event, add_event, #browser, completed?, config, #console, crawl!, engine, failed?, #initialize, items, logger, name, parse!, pipelines, #request_to, running?, #save_to, start_urls, #storage, #unique?, update, visits

Constructor Details

This class inherits a constructor from Tanakai::Base