org.apache.pig.tools.pigstats.spark

Class SparkScriptState

java.lang.Object

org.apache.pig.tools.pigstats.ScriptState

org.apache.pig.tools.pigstats.spark.SparkScriptState

public class SparkScriptState
extends ScriptState

ScriptStates encapsulates settings for a Pig script that runs on a hadoop cluster. These settings are added to all Spark jobs spawned by the script and in turn are persisted in the hadoop job xml. With the properties already in the job xml, users who want to know the relations between the script and Spark jobs can derive them from the job xmls.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SparkScriptState.SparkScriptInfo

Nested classes/interfaces inherited from class org.apache.pig.tools.pigstats.ScriptState

ScriptState.AliasVisitor, ScriptState.FeatureVisitor, ScriptState.PIG_FEATURE, ScriptState.PIG_PROPERTY

Field Summary

Fields inherited from class org.apache.pig.tools.pigstats.ScriptState

commandLine, fileName, hadoopVersion, id, listeners, pigContext, pigVersion, scriptFeatures, serializedScript, truncatedScript

Constructor Summary

Constructors

Constructor and Description
SparkScriptState(String id)

Method Summary

Modifier and Type	Method and Description
SparkScriptState.SparkScriptInfo	getScriptInfo()
void	setScriptInfo(SparkOperPlan plan)

Methods inherited from class org.apache.pig.tools.pigstats.ScriptState

bitSetToLong, emitInitialPlanNotification, emitJobFailedNotification, emitjobFinishedNotification, emitJobsSubmittedNotification, emitJobStartedNotification, emitLaunchCompletedNotification, emitLaunchStartedNotification, emitOutputCompletedNotification, emitProgressUpdatedNotification, featureLongToString, get, getAllListeners, getCommandLine, getFileName, getHadoopVersion, getId, getPigContext, getPigVersion, getScript, getScriptFeatures, getSerializedScript, registerListener, setCommandLine, setFileName, setPigContext, setScript, setScript, setScript, setScriptFeatures, start, start

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkScriptState

public SparkScriptState(String id)

Method Detail

setScriptInfo

public void setScriptInfo(SparkOperPlan plan)

getScriptInfo

public SparkScriptState.SparkScriptInfo getScriptInfo()