org.apache.pig.backend.hadoop.executionengine.tez.runtime

Class PartitionerDefinedVertexManager

java.lang.Object

VertexManagerPlugin

org.apache.pig.backend.hadoop.executionengine.tez.runtime.PartitionerDefinedVertexManager

public class PartitionerDefinedVertexManager
extends VertexManagerPlugin

VertexManagerPlugin used by sorting job of order by and skewed join. What is does is to set parallelism of the sorting vertex according to numParallelism specified by the predecessor vertex. The complex part is the PigOrderByEdgeManager, which specify how partition in the previous setting routes to the new vertex setting

Constructor Summary

Constructors

Constructor and Description
PartitionerDefinedVertexManager(VertexManagerPluginContext context)

Method Summary

Methods

Modifier and Type	Method and Description
void	initialize()
void	onRootVertexInitialized(java.lang.String inputName, InputDescriptor inputDescriptor, java.util.List<Event> events)
void	onSourceTaskCompleted(java.lang.String srcVertexName, java.lang.Integer srcTaskId)
void	onVertexManagerEventReceived(VertexManagerEvent vmEvent)
void	onVertexStarted(java.util.Map<java.lang.String,java.util.List<java.lang.Integer>> completions)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PartitionerDefinedVertexManager

public PartitionerDefinedVertexManager(VertexManagerPluginContext context)

Method Detail

initialize

public void initialize()

onRootVertexInitialized

public void onRootVertexInitialized(java.lang.String inputName,
                           InputDescriptor inputDescriptor,
                           java.util.List<Event> events)

onSourceTaskCompleted

public void onSourceTaskCompleted(java.lang.String srcVertexName,
                         java.lang.Integer srcTaskId)

onVertexManagerEventReceived

public void onVertexManagerEventReceived(VertexManagerEvent vmEvent)

onVertexStarted

public void onVertexStarted(java.util.Map<java.lang.String,java.util.List<java.lang.Integer>> completions)