org.apache.pig.tools.pigstats.spark

Class SparkPigStatusReporter

java.lang.Object

org.apache.pig.tools.pigstats.spark.SparkPigStatusReporter

public class SparkPigStatusReporter
extends Object

Just like PigStatusReporter which will create/reset Hadoop counters, SparkPigStatusReporter will create/reset Spark counters. Note that, it is not suitable to make SparkCounters as a Singleton, it will be created/reset for a given pig script or a Dump/Store action in Grunt mode.

Method Summary

Modifier and Type	Method and Description
void	createCounter(String groupName, String counterName)
SparkCounters	getCounters()
static SparkPigStatusReporter	getInstance()
void	setCounters(SparkCounters counters)
static void	staticDataCleanup()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

staticDataCleanup

public static void staticDataCleanup()

getInstance

public static SparkPigStatusReporter getInstance()

createCounter

public void createCounter(String groupName,
                          String counterName)

getCounters

public SparkCounters getCounters()

setCounters

public void setCounters(SparkCounters counters)