Module: Hasta::IdentityMapper

Defined in:
lib/hasta/identity_mapper.rb

Overview

Used by any EMR job that required an identity mapper

Class Method Summary collapse

Class Method Details

.map(_, data_sources, data_sink = InMemoryDataSink.new) ⇒ Object



8
9
10
11
12
13
14
15
# File 'lib/hasta/identity_mapper.rb', line 8

def self.map(_, data_sources, data_sink = InMemoryDataSink.new)
  Hasta.logger.debug "Starting Identity Mapper"
  CombinedDataSource.new(data_sources).each_line do |line|
    data_sink << line.rstrip
  end

  data_sink.close.tap { Hasta.logger.debug "Finished Identity Mapper" }
end