Method: WebRobots#error
- Defined in:
- lib/webrobots.rb
#error(url) ⇒ Object
Returns an error object if there is an error in fetching or parsing robots.txt of the site url
.
109 110 111 |
# File 'lib/webrobots.rb', line 109 def error(url) robots_txt_for(url).error end |