Class: RedshiftConnector::UrlDataFileBundle

Inherits:
AbstractDataFileBundle show all
Defined in:
lib/redshift-connector/data_file/url_data_file_bundle.rb

Constant Summary

Constants inherited from AbstractDataFileBundle

AbstractDataFileBundle::REPORT_SIZE

Instance Method Summary collapse

Methods inherited from AbstractDataFileBundle

#all_data_objects, #each_batch, #each_object, #each_row

Constructor Details

#initialize(data_file_urls, format: :redshift_csv, filter: nil, logger: DataFile.logger) ⇒ UrlDataFileBundle

Returns a new instance of UrlDataFileBundle.



8
9
10
11
12
13
 
# File 'lib/redshift-connector/data_file/url_data_file_bundle.rb', line 8

def initialize(data_file_urls, format: :redshift_csv, filter: nil, logger: DataFile.logger)
  @data_file_urls = data_file_urls
  @filter = filter || lambda {|*row| row }
  @logger = logger
  @reader_class = Reader.get(format)
end

Instance Method Details

#data_files ⇒ Object 



15
16
17
18
19
 
# File 'lib/redshift-connector/data_file/url_data_file_bundle.rb', line 15

def data_files
  @data_file_urls.map do |url|
    UrlDataFile.new(url, reader_class: @reader_class)
  end
end