Class: Morito::Client

Inherits:
Object
  • Object
show all
Defined in:
lib/morito/client.rb

Instance Method Summary collapse

Constructor Details

#initialize(user_agent) ⇒ Client

Returns a new instance of Client.



5
6
7
# File 'lib/morito/client.rb', line 5

def initialize(user_agent)
  @user_agent = user_agent
end

Instance Method Details

#allowed?(requesting_url, cache: true) ⇒ Boolean

Returns:

  • (Boolean)


9
10
11
12
13
# File 'lib/morito/client.rb', line 9

def allowed?(requesting_url, cache: true)
  uri = URI.parse(requesting_url)
  robots_txt_body = robots_txt_body(uri, cache: cache)
  Morito::Processor.new(robots_txt_body).allowed?(@user_agent, path(uri))
end