org.apache.pig.tools.pigstats.tez

Class TezScriptState

java.lang.Object

org.apache.pig.tools.pigstats.ScriptState

org.apache.pig.tools.pigstats.tez.TezScriptState

public class TezScriptState
extends ScriptState

ScriptStates encapsulates settings for a Pig script that runs on a hadoop cluster. These settings are added to all Tez jobs spawned by the script and in turn are persisted in the hadoop job xml. With the properties already in the job xml, users who want to know the relations between the script and Tez jobs can derive them from the job xmls.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TezScriptState.TezDAGScriptInfo

Nested classes/interfaces inherited from class org.apache.pig.tools.pigstats.ScriptState

ScriptState.AliasVisitor, ScriptState.FeatureVisitor, ScriptState.PIG_FEATURE, ScriptState.PIG_PROPERTY

Field Summary

Fields inherited from class org.apache.pig.tools.pigstats.ScriptState

commandLine, fileName, hadoopVersion, id, listeners, pigContext, pigVersion, scriptFeatures, serializedScript, truncatedScript

Constructor Summary

Constructors

Constructor and Description
TezScriptState(String id)

Method Summary

Modifier and Type	Method and Description
void	addDAGSettingsToConf(org.apache.hadoop.conf.Configuration conf)
void	addVertexSettingsToConf(String dagName, TezOperator tezOp, org.apache.hadoop.conf.Configuration conf)
void	addWorkflowAdjacenciesToConf(TezOperPlan tezPlan, org.apache.hadoop.conf.Configuration conf)
void	dagCompletedNotification(String dagName, TezDAGStats tezDAGStats)
void	dagLaunchNotification(String dagName, OperatorPlan<?> dagPlan, int numVerticesToLaunch)
void	dagProgressNotification(String dagName, int numVerticesCompleted, int progress)
void	dagStartedNotification(String dagName, String assignedApplicationId)
static TezScriptState	get()
TezScriptState.TezDAGScriptInfo	getDAGScriptInfo(String dagName)
void	registerListener(PigProgressNotificationListener listener)
TezScriptState.TezDAGScriptInfo	setDAGScriptInfo(TezPlanContainerNode tezPlanNode)

Methods inherited from class org.apache.pig.tools.pigstats.ScriptState

bitSetToLong, emitInitialPlanNotification, emitJobFailedNotification, emitjobFinishedNotification, emitJobsSubmittedNotification, emitJobStartedNotification, emitLaunchCompletedNotification, emitLaunchStartedNotification, emitOutputCompletedNotification, emitProgressUpdatedNotification, featureLongToString, getAllListeners, getCommandLine, getFileName, getHadoopVersion, getId, getPigContext, getPigVersion, getScript, getScriptFeatures, getSerializedScript, setCommandLine, setFileName, setPigContext, setScript, setScript, setScript, setScriptFeatures, start, start

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TezScriptState

public TezScriptState(String id)

Method Detail

get

public static TezScriptState get()

registerListener

public void registerListener(PigProgressNotificationListener listener)

Overrides:

registerListener in class ScriptState

dagLaunchNotification

public void dagLaunchNotification(String dagName,
                                  OperatorPlan<?> dagPlan,
                                  int numVerticesToLaunch)

dagStartedNotification

public void dagStartedNotification(String dagName,
                                   String assignedApplicationId)

dagProgressNotification

public void dagProgressNotification(String dagName,
                                    int numVerticesCompleted,
                                    int progress)

dagCompletedNotification

public void dagCompletedNotification(String dagName,
                                     TezDAGStats tezDAGStats)

addDAGSettingsToConf

public void addDAGSettingsToConf(org.apache.hadoop.conf.Configuration conf)

addVertexSettingsToConf

public void addVertexSettingsToConf(String dagName,
                                    TezOperator tezOp,
                                    org.apache.hadoop.conf.Configuration conf)

addWorkflowAdjacenciesToConf

public void addWorkflowAdjacenciesToConf(TezOperPlan tezPlan,
                                         org.apache.hadoop.conf.Configuration conf)

setDAGScriptInfo

public TezScriptState.TezDAGScriptInfo setDAGScriptInfo(TezPlanContainerNode tezPlanNode)

getDAGScriptInfo

public TezScriptState.TezDAGScriptInfo getDAGScriptInfo(String dagName)