org.apache.pig.tools.pigstats.tez

Class TezDAGStats

java.lang.Object

org.apache.pig.newplan.Operator

org.apache.pig.tools.pigstats.JobStats

org.apache.pig.tools.pigstats.tez.TezDAGStats

public class TezDAGStats
extends JobStats

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.tools.pigstats.JobStats

JobStats.JobState

Field Summary

Fields

Modifier and Type	Field and Description
static String	DAG_COUNTER_GROUP
static String	FAILURE_HEADER
static String	FS_COUNTER_GROUP
static String	PIG_COUNTER_GROUP
static String	SUCCESS_HEADER
static String	TASK_COUNTER_GROUP

Fields inherited from class org.apache.pig.tools.pigstats.JobStats

ALIAS, ALIAS_LOCATION, conf, FEATURE, hdfsBytesRead, hdfsBytesWritten, inputs, outputs, state

Fields inherited from class org.apache.pig.newplan.Operator

annotations, hashPrime, location, name, plan

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	TezDAGStats(String name, PigStats.JobGraph plan, Map<String,TezVertexStats> tezVertexStatsMap, StringBuilder tezDAGPlan)

Method Summary

Modifier and Type	Method and Description
void	accept(PlanVisitor v) Accept a visitor at this node in the graph.
void	accumulateStats(TezJob tezJob) Updates the statistics after a DAG is finished.
long	getAvgMapTime() Deprecated.
long	getAvgREduceTime() Deprecated.
String	getDisplayString()
org.apache.hadoop.mapred.Counters	getHadoopCounters() Deprecated.
String	getJobId()
long	getMapInputRecords() Deprecated.
long	getMapOutputRecords() Deprecated.
long	getMaxMapTime() Deprecated.
long	getMaxReduceTime() Deprecated.
long	getMinMapTime() Deprecated.
long	getMinReduceTime() Deprecated.
Map<String,Long>	getMultiInputCounters() Deprecated.
Map<String,Long>	getMultiStoreCounters() Deprecated.
int	getNumberMaps() Deprecated.
int	getNumberReduces() Deprecated.
long	getProactiveSpillCountObjects()
long	getProactiveSpillCountRecs()
long	getReduceInputRecords() Deprecated.
long	getReduceOutputRecords() Deprecated.
long	getSMMSpillCount()
TezVertexStats	getVertexStats(String vertexName)
void	setJobId(String appId)

Methods inherited from class org.apache.pig.tools.pigstats.JobStats

calculateMedianValue, getAlias, getAliasLocation, getBytesWritten, getErrorMessage, getException, getFeature, getHdfsBytesRead, getHdfsBytesWritten, getInputs, getOutputs, getOutputSize, getRecordWrittern, getState, isEqual, isIndexer, isSampler, isSuccessful, setBackendException, setConf, setErrorMsg, setSuccessful

Methods inherited from class org.apache.pig.newplan.Operator

annotate, getAnnotation, getLocation, getName, getPlan, removeAnnotation, setLocation, setPlan

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DAG_COUNTER_GROUP

public static final String DAG_COUNTER_GROUP

FS_COUNTER_GROUP

public static final String FS_COUNTER_GROUP

TASK_COUNTER_GROUP

public static final String TASK_COUNTER_GROUP

PIG_COUNTER_GROUP

public static final String PIG_COUNTER_GROUP

SUCCESS_HEADER

public static final String SUCCESS_HEADER

FAILURE_HEADER

public static final String FAILURE_HEADER

Constructor Detail

TezDAGStats

protected TezDAGStats(String name,
                      PigStats.JobGraph plan,
                      Map<String,TezVertexStats> tezVertexStatsMap,
                      StringBuilder tezDAGPlan)

Method Detail

getVertexStats

public TezVertexStats getVertexStats(String vertexName)

accumulateStats

public void accumulateStats(TezJob tezJob)
                     throws IOException

Updates the statistics after a DAG is finished.

Throws:

IOException

getJobId

public String getJobId()

Specified by:

getJobId in class JobStats

setJobId

public void setJobId(String appId)

accept

public void accept(PlanVisitor v)
            throws FrontendException

Description copied from class: Operator

Accept a visitor at this node in the graph.

Specified by:

accept in class JobStats

Parameters:

v - Visitor to accept.

Throws:

FrontendException

getDisplayString

public String getDisplayString()

Specified by:

getDisplayString in class JobStats

getNumberMaps

@Deprecated
public int getNumberMaps()

Deprecated.

Specified by:

getNumberMaps in class JobStats

getNumberReduces

@Deprecated
public int getNumberReduces()

Deprecated.

Specified by:

getNumberReduces in class JobStats

getMaxMapTime

@Deprecated
public long getMaxMapTime()

Deprecated.

Specified by:

getMaxMapTime in class JobStats

getMinMapTime

@Deprecated
public long getMinMapTime()

Deprecated.

Specified by:

getMinMapTime in class JobStats

getAvgMapTime

@Deprecated
public long getAvgMapTime()

Deprecated.

Specified by:

getAvgMapTime in class JobStats

getMaxReduceTime

@Deprecated
public long getMaxReduceTime()

Deprecated.

Specified by:

getMaxReduceTime in class JobStats

getMinReduceTime

@Deprecated
public long getMinReduceTime()

Deprecated.

Specified by:

getMinReduceTime in class JobStats

getAvgREduceTime

@Deprecated
public long getAvgREduceTime()

Deprecated.

Specified by:

getAvgREduceTime in class JobStats

getMapInputRecords

@Deprecated
public long getMapInputRecords()

Deprecated.

Specified by:

getMapInputRecords in class JobStats

getMapOutputRecords

@Deprecated
public long getMapOutputRecords()

Deprecated.

Specified by:

getMapOutputRecords in class JobStats

getReduceInputRecords

@Deprecated
public long getReduceInputRecords()

Deprecated.

Specified by:

getReduceInputRecords in class JobStats

getReduceOutputRecords

@Deprecated
public long getReduceOutputRecords()

Deprecated.

Specified by:

getReduceOutputRecords in class JobStats

getSMMSpillCount

public long getSMMSpillCount()

Specified by:

getSMMSpillCount in class JobStats

getProactiveSpillCountObjects

public long getProactiveSpillCountObjects()

Specified by:

getProactiveSpillCountObjects in class JobStats

getProactiveSpillCountRecs

public long getProactiveSpillCountRecs()

Specified by:

getProactiveSpillCountRecs in class JobStats

getHadoopCounters

@Deprecated
public org.apache.hadoop.mapred.Counters getHadoopCounters()

Deprecated.

Specified by:

getHadoopCounters in class JobStats

getMultiStoreCounters

@Deprecated
public Map<String,Long> getMultiStoreCounters()

Deprecated.

Specified by:

getMultiStoreCounters in class JobStats

getMultiInputCounters

@Deprecated
public Map<String,Long> getMultiInputCounters()

Deprecated.

Specified by:

getMultiInputCounters in class JobStats