Module: ScraperUtils
- Defined in:
- lib/scraper_utils.rb,
lib/scraper_utils/version.rb,
lib/scraper_utils/db_utils.rb,
lib/scraper_utils/log_utils.rb,
lib/scraper_utils/debug_utils.rb,
lib/scraper_utils/maths_utils.rb,
lib/scraper_utils/spec_support.rb,
lib/scraper_utils/authority_utils.rb,
lib/scraper_utils/mechanize_utils.rb,
lib/scraper_utils/data_quality_monitor.rb,
lib/scraper_utils/mechanize_utils/agent_config.rb
Overview
Utilities for planningalerts scrapers
Defined Under Namespace
Modules: AuthorityUtils, DbUtils, DebugUtils, LogUtils, MathsUtils, MechanizeUtils, SpecSupport Classes: DataQualityMonitor, Error, UnprocessableRecord, UnprocessableSite
Constant Summary collapse
- AUSTRALIAN_PROXY_ENV_VAR =
Constants for configuration on Morph.io
"MORPH_AUSTRALIAN_PROXY"
- VERSION =
"0.9.1"
Class Method Summary collapse
Class Method Details
.australian_proxy ⇒ Object
31 32 33 34 |
# File 'lib/scraper_utils.rb', line 31 def self.australian_proxy ap = ENV[AUSTRALIAN_PROXY_ENV_VAR].to_s ap.empty? ? nil : ap end |