org.apache.pig.tools.pigstats.tez

Class TezPigScriptStats

java.lang.Object

org.apache.pig.tools.pigstats.PigStats

org.apache.pig.tools.pigstats.tez.TezPigScriptStats

public class TezPigScriptStats
extends PigStats

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.tools.pigstats.PigStats

PigStats.JobGraph, PigStats.JobGraphPrinter

Field Summary

Fields inherited from class org.apache.pig.tools.pigstats.PigStats

aliasOuputMap, DATE_FORMAT, endTime, errorCode, errorMessage, errorThrowable, jobPlan, pigContext, returnCode, startTime, userId

Constructor Summary

Constructors

Constructor and Description
TezPigScriptStats(PigContext pigContext)

Method Summary

Methods

Modifier and Type	Method and Description
void	accumulateStats(TezJob tezJob) Updates the statistics after a DAG is finished.
TezDAGStats	addTezJobStatsForNative(String dagName, NativeTezOper tezOper, boolean success)
void	finish()
List<String>	getAllErrorMessages()
Map<String,List<PigStats>>	getAllStats()
org.apache.hadoop.mapred.JobClient	getJobClient()
long	getProactiveSpillCountObjects() Returns the total number of bags that spilled proactively
long	getProactiveSpillCountRecords() Returns the total number of records that spilled proactively
long	getSMMSpillCount() Returns the total spill counts from SpillableMemoryManager.
TezVertexStats	getVertexStats(String dagName, String vertexName)
void	initialize(TezPlanContainer tezPlanContainer)
boolean	isEmbedded()

Methods inherited from class org.apache.pig.tools.pigstats.PigStats

get, getBytesWritten, getDuration, getErrorCode, getErrorMessage, getErrorThrowable, getFeatures, getFileName, getHadoopVersion, getInputStats, getJobGraph, getNumberBytes, getNumberFailedJobs, getNumberJobs, getNumberRecords, getNumberSuccessfulJobs, getOutputAlias, getOutputLocations, getOutputNames, getOutputStats, getPigContext, getPigProperties, getPigVersion, getRecordWritten, getReturnCode, getScriptId, isSuccessful, result, setBackendException, setErrorCode, setErrorMessage, setErrorThrowable, setReturnCode, start, start, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TezPigScriptStats

public TezPigScriptStats(PigContext pigContext)

Method Detail

initialize

public void initialize(TezPlanContainer tezPlanContainer)

finish

public void finish()

accumulateStats

public void accumulateStats(TezJob tezJob)
                     throws IOException

Updates the statistics after a DAG is finished.

Throws:

IOException

addTezJobStatsForNative

public TezDAGStats addTezJobStatsForNative(String dagName,
                                  NativeTezOper tezOper,
                                  boolean success)

getVertexStats

public TezVertexStats getVertexStats(String dagName,
                            String vertexName)

isEmbedded

public boolean isEmbedded()

Specified by:

isEmbedded in class PigStats

getJobClient

public org.apache.hadoop.mapred.JobClient getJobClient()

Specified by:

getJobClient in class PigStats

getAllStats

public Map<String,List<PigStats>> getAllStats()

Specified by:

getAllStats in class PigStats

getAllErrorMessages

public List<String> getAllErrorMessages()

Specified by:

getAllErrorMessages in class PigStats

getSMMSpillCount

public long getSMMSpillCount()

Description copied from class: PigStats

Returns the total spill counts from SpillableMemoryManager.

Specified by:

getSMMSpillCount in class PigStats

getProactiveSpillCountObjects

public long getProactiveSpillCountObjects()

Description copied from class: PigStats

Returns the total number of bags that spilled proactively

Specified by:

getProactiveSpillCountObjects in class PigStats

getProactiveSpillCountRecords

public long getProactiveSpillCountRecords()

Description copied from class: PigStats

Returns the total number of records that spilled proactively

Specified by:

getProactiveSpillCountRecords in class PigStats