micro-spider
A DSL to write web spider. Depend on capybara and capybara-webkit.
Example
require 'micro_spider'
spider = MicroSpider.new
spider.learn do
site 'http://www.bbc.com'
entrance '/news'
field :top_story, '#top-story h2 a'
follow '.story' do
field :title, 'h1.story-header'
field :body, '.story-body'
fields :related_stories, '.related-links-list a'
end
end
spider.crawl