Top Level Namespace

Includes:
HadoopDsl

Defined Under Namespace

Modules: HadoopDsl

Constant Summary

Constants included from HadoopDsl

HadoopDsl::IntWritable, HadoopDsl::Text

Instance Method Summary collapse

Methods included from HadoopDsl

dsl_init_script, lib_path, read_file, reset_dsl_file, snake_case

Instance Method Details

#map(key, value, output, reporter, script) ⇒ Object 



5
6
7
8
9
10
 
# File 'lib/dsl_init.rb', line 5

def map(key, value, output, reporter, script)
  mapper = MapperFactory.create(script, key, value)
  mapper.run

  write(output, mapper)
end

#reduce(key, values, output, reporter, script) ⇒ Object 



12
13
14
15
16
17
 
# File 'lib/dsl_init.rb', line 12

def reduce(key, values, output, reporter, script)
  reducer = ReducerFactory.create(script, key, values)
  reducer.run

  write(output, reducer)
end

#setup(conf, script) ⇒ Object 



19
20
21
22
23
 
# File 'lib/dsl_init.rb', line 19

def setup(conf, script)
  setup = SetupFactory.create(script, conf)
  setup.run
  setup.paths
end