Class: Spark::Command::MapPartitions

Inherits:

MapPartitionsWithIndex

• Object
• MapPartitionsWithIndex
• Spark::Command::MapPartitions

Defined in:

lib/spark/command/basic.rb

Overview

---

MapPartitions

Instance Method Summary

• #run(iterator) ⇒ Object

Instance Method Details

#run(iterator) ⇒ Object

# File 'lib/spark/command/basic.rb', line 59

def run(iterator, *)
  # Do not use `super` because `@partition_function` can be method with 1 argument
  iterator = @partition_function.call(iterator)
  iterator
end