Method: Mechanize::HTTP::Agent#robots_error
- Defined in:
- lib/mechanize/http/agent.rb
#robots_error(url) ⇒ Object
Returns an error object if there is an error in fetching or parsing robots.txt of the site url.
1130 1131 1132 |
# File 'lib/mechanize/http/agent.rb', line 1130 def robots_error(url) webrobots.error(url) end |