Method: Mechanize::HTTP::Agent#robots_error!
- Defined in:
- lib/mechanize/http/agent.rb
permalink #robots_error!(url) ⇒ Object
Raises the error if there is an error in fetching or parsing robots.txt of the site url
.
1136 1137 1138 |
# File 'lib/mechanize/http/agent.rb', line 1136 def robots_error!(url) webrobots.error!(url) end |