Module: Textoken

Defined in:
lib/textoken.rb,
lib/textoken/base.rb,
lib/textoken/errors.rb,
lib/textoken/options.rb,
lib/textoken/scanner.rb,
lib/textoken/version.rb,
lib/textoken/findings.rb,
lib/textoken/searcher.rb,
lib/textoken/tokenizer.rb,
lib/textoken/options/only.rb,
lib/textoken/options/exclude.rb,
lib/textoken/options/less_than.rb,
lib/textoken/options/more_than.rb,
lib/textoken/options/only_regexp.rb,
lib/textoken/options/exclude_regexp.rb,
lib/textoken/factories/option_factory.rb,
lib/textoken/options/modules/regexp_option.rb,
lib/textoken/options/modules/numeric_option.rb,
lib/textoken/options/modules/conditional_option.rb,
lib/textoken/options/modules/tokenizable_option.rb

Overview

Textoken is a library for customizable tokenization of texts. Customizable tokenization can be used in many areas including NLP purposes

Defined Under Namespace

Modules: ConditionalOption, NumericOption, OptionFactory, RegexpOption, TokenizableOption Classes: Base, Exclude, ExcludeRegexp, ExpressionError, Findings, LessThan, MoreThan, Only, OnlyRegexp, Options, Scanner, Searcher, Tokenizer, TypeError

Constant Summary collapse

GEM_ROOT = 
File.expand_path('../..', __FILE__)
VERSION = 
"1.1.2"

Class Method Summary collapse

Class Method Details

.expression_err(msg) ⇒ Object

Expression error raised in wrong user input of options & values



32
33
34
 
# File 'lib/textoken.rb', line 32

def expression_err(msg)
  fail ExpressionError, msg
end

.type_err(msg) ⇒ Object

Type error raised when user input format is right but the option value is not suitable for option



38
39
40
 
# File 'lib/textoken.rb', line 38

def type_err(msg)
  fail TypeError, msg
end