Class: Monet::CaptureMap::PathSpider

Inherits:

PathCollection

• Object
• PathCollection
• Monet::CaptureMap::PathSpider

Defined in:

lib/monet/capture_map.rb

Constant Summary

SKIP_EXT =

%w(js css png jpg mp4 txt zip ico ogv ogg pdf gz)

SKIP_PATHS =

[/\?.*/]

Instance Attribute Summary

Attributes inherited from PathCollection

#root_url

Instance Method Summary

• #ignores ⇒ Object
• #paths ⇒ Object

Methods inherited from PathCollection

#add, #initialize, #normalized_path

Constructor Details

This class inherits a constructor from Monet::CaptureMap::PathCollection

Instance Method Details

#ignores ⇒ Object

# File 'lib/monet/capture_map.rb', line 38

def ignores
  SKIP_EXT.map {|x| Regexp.new x }.concat SKIP_PATHS
end

#paths ⇒ Object

# File 'lib/monet/capture_map.rb', line 34

def paths
  @paths = normalize Spidr.site(@root_url, ignore_links: ignores)
end