Method: Mechanize::HTTP::Agent#robots
- Defined in:
- lib/mechanize/http/agent.rb
#robots ⇒ Object
When true, this agent will consult the site’s robots.txt for each access.
88 89 90 |
# File 'lib/mechanize/http/agent.rb', line 88 def robots @robots end |