Method: MapRedus::Master.mapreduce
- Defined in:
- lib/mapredus/master.rb
.mapreduce(process, *data_object) ⇒ Object
The order of operations that occur in the mapreduce process
The inputter sets off the mapper processes
34 35 36 37 38 39 40 41 42 43 44 45 46 |
# File 'lib/mapredus/master.rb', line 34 def self.mapreduce( process, *data_object ) start_metrics(process.pid) if process.synchronous process.update(:state => INPUT_MAP_IN_PROGRESS) enslave_inputter(process, *data_object) process.update(:state => REDUCE_IN_PROGRESS) enslave_reducers(process) process.update(:state => FINALIZER_IN_PROGRESS) enslave_finalizer(process) else Resque.push(QueueProcess.queue, {:class => MapRedus::Master , :args => [process.pid, data_object]} ) end end |