Method: RedshiftConnector::UrlDataFileBundle#initialize

Defined in:
lib/redshift_connector/url_data_file_bundle.rb

#initialize(urls, format: :redshift_csv, filter: nil, logger: RedshiftConnector.logger) ⇒ UrlDataFileBundle

Returns a new instance of UrlDataFileBundle.

Raises:

  • (ArgumentError)


9
10
11
12
13
14
15
# File 'lib/redshift_connector/url_data_file_bundle.rb', line 9

def initialize(urls, format: :redshift_csv, filter: nil, logger: RedshiftConnector.logger)
  super filter: filter, batch_size: 1000, logger: logger
  reader_class = Reader.get(format)
  raise ArgumentError, 'no URL given' if urls.empty?
  @data_files = urls.map {|url| UrlDataFile.new(URI.parse(url), reader_class: reader_class) }
  logger.info "reader: #{reader_class}"
end