Module: ScraperUtils

Defined in:
lib/scraper_utils.rb,
lib/scraper_utils/version.rb,
lib/scraper_utils/db_utils.rb,
lib/scraper_utils/log_utils.rb,
lib/scraper_utils/debug_utils.rb,
lib/scraper_utils/maths_utils.rb,
lib/scraper_utils/spec_support.rb,
lib/scraper_utils/authority_utils.rb,
lib/scraper_utils/mechanize_utils.rb,
lib/scraper_utils/data_quality_monitor.rb,
lib/scraper_utils/mechanize_utils/agent_config.rb

Overview

Utilities for planningalerts scrapers

Defined Under Namespace

Modules: AuthorityUtils, DbUtils, DebugUtils, LogUtils, MathsUtils, MechanizeUtils, SpecSupport Classes: DataQualityMonitor, Error, UnprocessableRecord, UnprocessableSite

Constant Summary collapse

AUSTRALIAN_PROXY_ENV_VAR =

Constants for configuration on Morph.io

"MORPH_AUSTRALIAN_PROXY"
VERSION =
"0.9.1"

Class Method Summary collapse

Class Method Details

.australian_proxyObject



31
32
33
34
# File 'lib/scraper_utils.rb', line 31

def self.australian_proxy
  ap = ENV[AUSTRALIAN_PROXY_ENV_VAR].to_s
  ap.empty? ? nil : ap
end