Module: Gort

Defined in:
lib/gort.rb,
lib/gort/rule.rb,
lib/gort/group.rb,
lib/gort/parser.rb,
lib/gort/version.rb,
lib/gort/rule_set.rb,
lib/gort/path_rule.rb,
lib/gort/allow_rule.rb,
lib/gort/robots_txt.rb,
lib/gort/invalid_line.rb,
lib/gort/disallow_rule.rb,
lib/gort/user_agent_rule.rb

Overview

Gort is a robots.txt parser and evaluator.

Defined Under Namespace

Classes: AllowRule, DisallowRule, Error, Group, InvalidLine, Parser, PathRule, RobotsTxt, Rule, RuleSet, UserAgentRule

Constant Summary collapse

VERSION =

Gem version

"0.1.0"

Class Method Summary collapse

Class Method Details

.parse(input) ⇒ RobotsTxt

Parse the given robots.txt input and return a RobotsTxt instance.

Parameters:

  • input (String) —

    the robots.txt input to parse

Returns:



14
15
16
 
# File 'lib/gort.rb', line 14

def self.parse(input)
  Parser.new(input).parse
end