Module: Crawlr

Defined in:
lib/crawlr.rb,
lib/crawlr/hooks.rb,
lib/crawlr/config.rb,
lib/crawlr/parser.rb,
lib/crawlr/robots.rb,
lib/crawlr/visits.rb,
lib/crawlr/context.rb,
lib/crawlr/domains.rb,
lib/crawlr/version.rb,
lib/crawlr/callbacks.rb,
lib/crawlr/collector.rb,
lib/crawlr/cookie_jar.rb,
lib/crawlr/http_interface.rb

Overview

A Ruby scraping framework for parsing HTML and XML documents

Since:

  • 0.1.0

Defined Under Namespace

Modules: Parser Classes: Callbacks, Collector, Config, Context, CookieJar, Domains, Error, HTTPInterface, Hooks, Robots, Visits

Constant Summary collapse

VERSION =

Since:

  • 0.1.0

"0.2.3"

Class Attribute Summary collapse

Class Attribute Details

.logger ⇒ Object

Since:

  • 0.1.0



14
15
16
 
# File 'lib/crawlr.rb', line 14

def logger
  @logger
end