Module: Anemone

Defined in:
lib/anemone/http.rb,
lib/anemone/core.rb,
lib/anemone/page.rb,
lib/anemone/storage.rb,
lib/anemone/tentacle.rb,
lib/anemone/exceptions.rb,
lib/anemone/page_store.rb,
lib/anemone/storage/base.rb,
lib/anemone/storage/redis.rb,
lib/anemone/storage/pstore.rb,
lib/anemone/storage/mongodb.rb,
lib/anemone/storage/exceptions.rb,
lib/anemone/storage/tokyo_cabinet.rb,
lib/anemone/cookie_store.rb

Overview

Overides Anemone’s Page class methods:<br/> o in_domain?( uri ): adding support for subdomain crawling<br/> o links(): adding support for frame and iframe src URLs<br/>

@author: Tasos “Zapotek” Laskos

<tasos.laskos@gmail.com>
<zapotek@segfault.gr>

@version: 0.1

Defined Under Namespace

Modules: Extractors, Storage Classes: CookieStore, Core, Error, HTTP, Page, PageStore, Tentacle

Constant Summary collapse

VERSION = 
'0.5.0'

Class Method Summary collapse

Class Method Details

.crawl(urls, options = {}, &block) ⇒ Object

Convenience method to start a crawl



29
30
31
 
# File 'lib/anemone/core.rb', line 29

def Anemone.crawl(urls, options = {}, &block)
  Core.crawl(urls, options, &block)
end