org.apache.pig.backend.hadoop.executionengine.tez.runtime

Class PartitionerDefinedVertexManager

java.lang.Object

org.apache.tez.dag.api.VertexManagerPlugin

org.apache.pig.backend.hadoop.executionengine.tez.runtime.PartitionerDefinedVertexManager

public class PartitionerDefinedVertexManager
extends org.apache.tez.dag.api.VertexManagerPlugin

VertexManagerPlugin used by sorting job of order by and skewed join. What is does is to set parallelism of the sorting vertex according to numParallelism specified by the predecessor vertex. The complex part is the PigOrderByEdgeManager, which specify how partition in the previous setting routes to the new vertex setting

Constructor Summary

Constructors

Constructor and Description
PartitionerDefinedVertexManager(org.apache.tez.dag.api.VertexManagerPluginContext context)

Method Summary

Modifier and Type	Method and Description
void	initialize()
void	onRootVertexInitialized(String inputName, org.apache.tez.dag.api.InputDescriptor inputDescriptor, List<org.apache.tez.runtime.api.Event> events)
void	onSourceTaskCompleted(String srcVertexName, Integer srcTaskId)
void	onVertexManagerEventReceived(org.apache.tez.runtime.api.events.VertexManagerEvent vmEvent)
void	onVertexStarted(Map<String,List<Integer>> completions)
void	onVertexStateUpdated(org.apache.tez.dag.api.event.VertexStateUpdate stateUpdate)

Methods inherited from class org.apache.tez.dag.api.VertexManagerPlugin

getContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PartitionerDefinedVertexManager

public PartitionerDefinedVertexManager(org.apache.tez.dag.api.VertexManagerPluginContext context)

Method Detail

initialize

public void initialize()

Specified by:

initialize in class org.apache.tez.dag.api.VertexManagerPlugin

onVertexStateUpdated

public void onVertexStateUpdated(org.apache.tez.dag.api.event.VertexStateUpdate stateUpdate)
                          throws Exception

Overrides:

onVertexStateUpdated in class org.apache.tez.dag.api.VertexManagerPlugin

Throws:

Exception

onRootVertexInitialized

public void onRootVertexInitialized(String inputName,
                                    org.apache.tez.dag.api.InputDescriptor inputDescriptor,
                                    List<org.apache.tez.runtime.api.Event> events)

Specified by:

onRootVertexInitialized in class org.apache.tez.dag.api.VertexManagerPlugin

onSourceTaskCompleted

public void onSourceTaskCompleted(String srcVertexName,
                                  Integer srcTaskId)

Specified by:

onSourceTaskCompleted in class org.apache.tez.dag.api.VertexManagerPlugin

onVertexManagerEventReceived

public void onVertexManagerEventReceived(org.apache.tez.runtime.api.events.VertexManagerEvent vmEvent)
                                  throws Exception

Specified by:

onVertexManagerEventReceived in class org.apache.tez.dag.api.VertexManagerPlugin

Throws:

Exception

onVertexStarted

public void onVertexStarted(Map<String,List<Integer>> completions)

Specified by:

onVertexStarted in class org.apache.tez.dag.api.VertexManagerPlugin