TezOperator (Pig 0.14.0 API)

java.lang.Object
- org.apache.pig.impl.plan.Operator<TezOpPlanVisitor>
- - org.apache.pig.backend.hadoop.executionengine.tez.plan.TezOperator

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.lang.Comparable<Operator>

Direct Known Subclasses:

NativeTezOper
```
public class TezOperator
extends Operator<TezOpPlanVisitor>
```
An operator model for a Tez job. Acts as a host to the plans that will execute in Tez vertices.

See Also:
Serialized Form

Nested Class Summary

Nested Classes
Modifier and Type Class and Description

static class TezOperator.LoaderInfo

static class TezOperator.OPER_FEATURE

static class TezOperator.VertexGroupInfo

Nested Classes
Modifier and Type	Class and Description
`static class`	`TezOperator.LoaderInfo`
`static class`	`TezOperator.OPER_FEATURE`
`static class`	`TezOperator.VertexGroupInfo`

Field Summary

Fields
Modifier and Type	Field and Description
`java.util.Map<OperatorKey,TezEdgeDescriptor>`	`inEdges`
`java.util.Map<OperatorKey,TezEdgeDescriptor>`	`outEdges`
`PhysicalPlan`	`plan`
`java.util.Set<PhysicalOperator>`	`scalars`
`java.util.Set<java.lang.String>`	`UDFs`

Fields inherited from class org.apache.pig.impl.plan.Operator
mKey

Constructor Summary

Constructors
Constructor and Description

TezOperator(OperatorKey k)

Constructors
Constructor and Description
`TezOperator(OperatorKey k)`

Method Summary

Methods
Modifier and Type	Method and Description
`void`	`addCrossKey(java.lang.String key)`
`void`	`addUnionPredecessor(OperatorKey unionPredecessor)`
`void`	`addVertexGroupStore(OperatorKey storeKey, OperatorKey vertexGroupKey)`
`boolean`	`combineSmallSplits()`
`void`	`copyFeatures(TezOperator copyFrom, java.util.List<TezOperator.OPER_FEATURE> excludeFeatures)`
`java.util.List<java.lang.String>`	`getCrossKeys()`
`int`	`getEffectiveParallelism()`
`int`	`getEstimatedParallelism()`
`TezOperator.LoaderInfo`	`getLoaderInfo()`
`java.lang.String`	`getProcessorName()`
`int`	`getRequestedParallelism()`
`TezOperator`	`getSampleOperator()`
`TezOperator`	`getSortOperator()`
`boolean[]`	`getSortOrder()`
`OperatorKey`	`getSplitParent()`
`java.util.List<OperatorKey>`	`getUnionPredecessors()`
`TezOperator.VertexGroupInfo`	`getVertexGroupInfo()`
`java.util.List<OperatorKey>`	`getVertexGroupMembers()`
`java.util.Map<OperatorKey,OperatorKey>`	`getVertexGroupStores()`
`int`	`getVertexParallelism()`
`boolean`	`isClosed()`
`boolean`	`isCogroup()`
`boolean`	`isDontEstimateParallelism()`
`boolean`	`isGlobalSort()`
`boolean`	`isGroupBy()`
`boolean`	`isIndexer()`
`boolean`	`isLimit()`
`boolean`	`isLimitAfterSort()`
`boolean`	`isNative()`
`boolean`	`isNeedEstimateParallelism()`
`boolean`	`isOverrideIntermediateParallelism()`
`boolean`	`isRegularJoin()`
`boolean`	`isSampleAggregation()`
`boolean`	`isSampleBasedPartitioner()`
`boolean`	`isSampler()`
`boolean`	`isSkewedJoin()`
`boolean`	`isSplitter()`
`boolean`	`isUnion()`
`boolean`	`isUseMRMapSettings()`
`boolean`	`isUseSecondaryKey()`
`boolean`	`isVertexGroup()`
`void`	`markCogroup()`
`void`	`markGlobalSort()`
`void`	`markGroupBy()`
`void`	`markIndexer()`
`void`	`markLimit()`
`void`	`markLimitAfterSort()`
`void`	`markNative()`
`void`	`markRegularJoin()`
`void`	`markSampleAggregation()`
`void`	`markSampleBasedPartitioner()`
`void`	`markSampler()`
`void`	`markSkewedJoin()`
`void`	`markUnion()`
`java.lang.String`	`name()`
`boolean`	`needSegmentBelow()`
`protected void`	`noCombineSmallSplits()`
`void`	`setClosed(boolean closed)`
`void`	`setDontEstimateParallelism(boolean dontEstimateParallelism)`
`void`	`setEstimatedParallelism(int estimatedParallelism)`
`void`	`setNeedEstimatedQuantile(boolean needEstimateParallelism)`
`void`	`setOverrideIntermediateParallelism(boolean overrideIntermediateParallelism)`
`void`	`setRequestedParallelism(int requestedParallelism)`
`void`	`setRequestedParallelismByReference(TezOperator oper)`
`void`	`setSampleOperator(TezOperator sampleOperator)`
`void`	`setSortOperator(TezOperator sortOperator)`
`void`	`setSortOrder(boolean[] sortOrder)`
`void`	`setSplitParent(OperatorKey splitParent)`
`void`	`setSplitter(boolean spl)`
`void`	`setUseMRMapSettings(boolean useMRMapSettings)`
`void`	`setUseSecondaryKey(boolean useSecondaryKey)`
`void`	`setVertexGroupInfo(TezOperator.VertexGroupInfo vertexGroup)`
`void`	`setVertexGroupMembers(java.util.List<OperatorKey> vertexGroupMembers)`
`void`	`setVertexParallelism(int vertexParallelism)`
`boolean`	`supportsMultipleInputs()` Indicates whether this operator supports multiple inputs.
`boolean`	`supportsMultipleOutputs()` Indicates whether this operator supports multiple outputs.
`java.lang.String`	`toString()`
`void`	`visit(TezOpPlanVisitor v)` Visit this node with the provided visitor.

Methods inherited from class org.apache.pig.impl.plan.Operator
clone, compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, unsetProjectionMap

Methods inherited from class java.lang.Object
finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

plan
```
public PhysicalPlan plan
```

outEdges

public java.util.Map<OperatorKey,TezEdgeDescriptor> outEdges

inEdges

public java.util.Map<OperatorKey,TezEdgeDescriptor> inEdges

UDFs

public java.util.Set<java.lang.String> UDFs

scalars

public java.util.Set<PhysicalOperator> scalars

Constructor Detail
- TezOperator
```
public TezOperator(OperatorKey k)
```

Method Detail

getProcessorName

public java.lang.String getProcessorName()

visit
```
public void visit(TezOpPlanVisitor v)
           throws VisitorException
```
Description copied from class: Operator

Visit this node with the provided visitor. This should only be called by the visitor class itself, never directly.

Specified by:

visit in class Operator<TezOpPlanVisitor>

Parameters:
v - Visitor to visit with.

Throws:

VisitorException - if the visitor has a problem.

supportsMultipleInputs
```
public boolean supportsMultipleInputs()
```
Description copied from class: Operator

Indicates whether this operator supports multiple inputs.

Specified by:

supportsMultipleInputs in class Operator<TezOpPlanVisitor>

Returns:
true if it does, otherwise false.

supportsMultipleOutputs
```
public boolean supportsMultipleOutputs()
```
Description copied from class: Operator

Indicates whether this operator supports multiple outputs.

Specified by:

supportsMultipleOutputs in class Operator<TezOpPlanVisitor>

Returns:
true if it does, otherwise false.

getRequestedParallelism
```
public int getRequestedParallelism()
```

setRequestedParallelism

public void setRequestedParallelism(int requestedParallelism)

setRequestedParallelismByReference

public void setRequestedParallelismByReference(TezOperator oper)

getEstimatedParallelism
```
public int getEstimatedParallelism()
```

setEstimatedParallelism

public void setEstimatedParallelism(int estimatedParallelism)

getEffectiveParallelism
```
public int getEffectiveParallelism()
```

isDontEstimateParallelism

public boolean isDontEstimateParallelism()

setDontEstimateParallelism

public void setDontEstimateParallelism(boolean dontEstimateParallelism)

isOverrideIntermediateParallelism

public boolean isOverrideIntermediateParallelism()

setOverrideIntermediateParallelism

public void setOverrideIntermediateParallelism(boolean overrideIntermediateParallelism)

getSplitParent
```
public OperatorKey getSplitParent()
```

setSplitParent

public void setSplitParent(OperatorKey splitParent)

setSplitter
```
public void setSplitter(boolean spl)
```

isSplitter
```
public boolean isSplitter()
```

isClosed
```
public boolean isClosed()
```

setClosed

public void setClosed(boolean closed)

isIndexer
```
public boolean isIndexer()
```

markIndexer
```
public void markIndexer()
```

isSampler
```
public boolean isSampler()
```

markSampler
```
public void markSampler()
```

isSampleAggregation
```
public boolean isSampleAggregation()
```

markSampleAggregation
```
public void markSampleAggregation()
```

isSampleBasedPartitioner

public boolean isSampleBasedPartitioner()

markSampleBasedPartitioner

public void markSampleBasedPartitioner()

isGlobalSort
```
public boolean isGlobalSort()
```

markGlobalSort
```
public void markGlobalSort()
```

isGroupBy
```
public boolean isGroupBy()
```

markGroupBy
```
public void markGroupBy()
```

isCogroup
```
public boolean isCogroup()
```

markCogroup
```
public void markCogroup()
```

isRegularJoin
```
public boolean isRegularJoin()
```

markRegularJoin
```
public void markRegularJoin()
```

isSkewedJoin
```
public boolean isSkewedJoin()
```

markSkewedJoin
```
public void markSkewedJoin()
```

isLimit
```
public boolean isLimit()
```

markLimit
```
public void markLimit()
```

isLimitAfterSort
```
public boolean isLimitAfterSort()
```

markLimitAfterSort
```
public void markLimitAfterSort()
```

isUnion
```
public boolean isUnion()
```

markUnion
```
public void markUnion()
```

isNative
```
public boolean isNative()
```

markNative
```
public void markNative()
```

copyFeatures

public void copyFeatures(TezOperator copyFrom,
                java.util.List<TezOperator.OPER_FEATURE> excludeFeatures)

setNeedEstimatedQuantile

public void setNeedEstimatedQuantile(boolean needEstimateParallelism)

isNeedEstimateParallelism

public boolean isNeedEstimateParallelism()

isUseSecondaryKey
```
public boolean isUseSecondaryKey()
```

setUseSecondaryKey

public void setUseSecondaryKey(boolean useSecondaryKey)

getUnionPredecessors

public java.util.List<OperatorKey> getUnionPredecessors()

getVertexGroupMembers

public java.util.List<OperatorKey> getVertexGroupMembers()

addUnionPredecessor

public void addUnionPredecessor(OperatorKey unionPredecessor)

setVertexGroupMembers

public void setVertexGroupMembers(java.util.List<OperatorKey> vertexGroupMembers)

isVertexGroup
```
public boolean isVertexGroup()
```

getVertexGroupInfo

public TezOperator.VertexGroupInfo getVertexGroupInfo()

setVertexGroupInfo

public void setVertexGroupInfo(TezOperator.VertexGroupInfo vertexGroup)

addVertexGroupStore

public void addVertexGroupStore(OperatorKey storeKey,
                       OperatorKey vertexGroupKey)

getVertexGroupStores

public java.util.Map<OperatorKey,OperatorKey> getVertexGroupStores()

name
```
public java.lang.String name()
```
Specified by:

name in class Operator<TezOpPlanVisitor>

toString
```
public java.lang.String toString()
```
Overrides:

toString in class Operator<TezOpPlanVisitor>

needSegmentBelow
```
public boolean needSegmentBelow()
```

setSortOrder

public void setSortOrder(boolean[] sortOrder)

getSortOrder
```
public boolean[] getSortOrder()
```

getSampleOperator

public TezOperator getSampleOperator()

setSampleOperator

public void setSampleOperator(TezOperator sampleOperator)

getSortOperator
```
public TezOperator getSortOperator()
```

setSortOperator

public void setSortOperator(TezOperator sortOperator)

noCombineSmallSplits
```
protected void noCombineSmallSplits()
```

combineSmallSplits
```
public boolean combineSmallSplits()
```

addCrossKey

public void addCrossKey(java.lang.String key)

getCrossKeys

public java.util.List<java.lang.String> getCrossKeys()

isUseMRMapSettings
```
public boolean isUseMRMapSettings()
```

setUseMRMapSettings

public void setUseMRMapSettings(boolean useMRMapSettings)

getVertexParallelism
```
public int getVertexParallelism()
```

setVertexParallelism

public void setVertexParallelism(int vertexParallelism)

getLoaderInfo

public TezOperator.LoaderInfo getLoaderInfo()

Class TezOperator

Nested Class Summary

Field Summary

Fields inherited from class org.apache.pig.impl.plan.Operator

Constructor Summary

Method Summary

Methods inherited from class org.apache.pig.impl.plan.Operator

Methods inherited from class java.lang.Object

Field Detail

plan

outEdges

inEdges

UDFs

scalars

Constructor Detail

TezOperator

Method Detail

getProcessorName

visit

supportsMultipleInputs

supportsMultipleOutputs

getRequestedParallelism

setRequestedParallelism

setRequestedParallelismByReference

getEstimatedParallelism

setEstimatedParallelism

getEffectiveParallelism

isDontEstimateParallelism

setDontEstimateParallelism

isOverrideIntermediateParallelism

setOverrideIntermediateParallelism

getSplitParent

setSplitParent

setSplitter

isSplitter

isClosed

setClosed

isIndexer

markIndexer

isSampler

markSampler

isSampleAggregation

markSampleAggregation

isSampleBasedPartitioner

markSampleBasedPartitioner

isGlobalSort

markGlobalSort

isGroupBy

markGroupBy

isCogroup

markCogroup

isRegularJoin

markRegularJoin

isSkewedJoin

markSkewedJoin

isLimit

markLimit

isLimitAfterSort

markLimitAfterSort

isUnion

markUnion

isNative

markNative

copyFeatures

setNeedEstimatedQuantile

isNeedEstimateParallelism

isUseSecondaryKey

setUseSecondaryKey

getUnionPredecessors

getVertexGroupMembers

addUnionPredecessor

setVertexGroupMembers

isVertexGroup

getVertexGroupInfo

setVertexGroupInfo

addVertexGroupStore

getVertexGroupStores

name

toString

needSegmentBelow