Package | Description |
---|---|
org.apache.pig.backend.hadoop.executionengine.physicalLayer |
Implementation of physical operators that use hadoop as the execution engine
and data storage.
|
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators | |
org.apache.pig.backend.hadoop.executionengine.spark.operator | |
org.apache.pig.backend.hadoop.executionengine.tez.plan.operator |
Modifier and Type | Field and Description |
---|---|
protected Result |
PhysicalOperator.res |
protected static Result |
PhysicalOperator.RESULT_EMPTY |
protected static Result |
PhysicalOperator.RESULT_EOP |
Modifier and Type | Method and Description |
---|---|
Result |
PhysicalOperator.getNext(byte dataType)
Implementations that call into the different versions of getNext are often
identical, differing only in the signature of the getNext() call they make.
|
Result |
PhysicalOperator.getNextBigDecimal() |
Result |
PhysicalOperator.getNextBigInteger() |
Result |
PhysicalOperator.getNextBoolean() |
Result |
PhysicalOperator.getNextDataBag() |
Result |
PhysicalOperator.getNextDataByteArray() |
Result |
PhysicalOperator.getNextDateTime() |
Result |
PhysicalOperator.getNextDouble() |
Result |
PhysicalOperator.getNextFloat() |
Result |
PhysicalOperator.getNextInteger() |
Result |
PhysicalOperator.getNextLong() |
Result |
PhysicalOperator.getNextMap() |
Result |
PhysicalOperator.getNextString() |
Result |
PhysicalOperator.getNextTuple() |
Result |
PhysicalOperator.processInput()
A generic method for parsing input that either returns the attached input
if it exists or fetches it from its predecessor.
|
Modifier and Type | Method and Description |
---|---|
protected Result |
POProject.consumeInputBag(Result input) |
Modifier and Type | Field and Description |
---|---|
protected Result |
POLocalRearrange.inp |
protected Result |
POPoissonSample.newSample |
Modifier and Type | Field and Description |
---|---|
protected BlockingQueue<Result> |
POStream.binaryInputQueue |
protected BlockingQueue<Result> |
POStream.binaryOutputQueue |
Modifier and Type | Method and Description |
---|---|
protected Result |
POCounter.addCounterValue(Result input)
Add current task id and local counter value.
|
Result |
PORank.addRank(Result input)
Reads the output tuple from POCounter and the cumulative sum previously calculated.
|
protected Result |
POPoissonSample.createNumRowTuple(Tuple sample) |
Result |
Packager.getNext() |
Result |
MultiQueryPackager.getNext()
Constructs the output tuple from the inputs.
|
Result |
LitePackager.getNext()
Similar to POPackage.getNext except that
only one input is expected with index 0
and ReadOnceBag is used instead of
DefaultDataBag.
|
Result |
JoinPackager.getNext()
Calls getNext to get next ForEach result.
|
Result |
CombinerPackager.getNext() |
Result |
POStream.getNextHelper(Tuple t) |
Result |
POUnion.getNextTuple()
The code below, tries to follow our single threaded
shared execution model with execution being passed
around each non-drained input
|
Result |
POStream.getNextTuple() |
Result |
POStore.getNextTuple() |
Result |
POSplit.getNextTuple() |
Result |
POSortedDistinct.getNextTuple() |
Result |
POSort.getNextTuple() |
Result |
POReservoirSample.getNextTuple() |
Result |
PORank.getNextTuple() |
Result |
POPreCombinerLocalRearrange.getNextTuple()
Calls getNext on the generate operator inside the nested
physical plan.
|
Result |
POPoissonSample.getNextTuple() |
Result |
POPartitionRearrange.getNextTuple()
Calls getNext on the generate operator inside the nested
physical plan.
|
Result |
POPartialAgg.getNextTuple() |
Result |
POPackage.getNextTuple()
From the inputs, constructs the output tuple for this co-group in the
required format which is (key, {bag of tuples from input 1}, {bag of
tuples from input 2}, ...)
|
Result |
POOptimizedForEach.getNextTuple()
Calls getNext on the generate operator inside the nested
physical plan and returns it maintaining an additional state
to denote the begin and end of the nested plan processing.
|
Result |
POMergeJoin.getNextTuple() |
Result |
POMergeCogroup.getNextTuple() |
Result |
POLocalRearrange.getNextTuple()
Calls getNext on the generate operator inside the nested
physical plan.
|
Result |
POLoad.getNextTuple()
The main method used by this operator's successor
to read tuples from the specified file using the
specified load function.
|
Result |
POLimit.getNextTuple()
Counts the number of tuples processed into static variable soFar, if the number of tuples processed reach the
limit, return EOP; Otherwise, return the tuple
|
Result |
POForEach.getNextTuple()
Calls getNext on the generate operator inside the nested
physical plan and returns it maintaining an additional state
to denote the begin and end of the nested plan processing.
|
Result |
POFilter.getNextTuple()
Attaches the proccesed input tuple to the expression plan and checks if
comparison operator returns a true.
|
Result |
POFRJoin.getNextTuple() |
Result |
PODistinct.getNextTuple() |
Result |
PODemux.getNextTuple() |
Result |
POCross.getNextTuple() |
Result |
POCounter.getNextTuple() |
Result |
POCollectedGroup.getNextTuple() |
protected Result |
POForEach.processPlan() |
Modifier and Type | Method and Description |
---|---|
BlockingQueue<Result> |
POStream.getBinaryInputQueue() |
BlockingQueue<Result> |
POStream.getBinaryOutputQueue() |
Modifier and Type | Method and Description |
---|---|
protected Result |
POCounter.addCounterValue(Result input)
Add current task id and local counter value.
|
Result |
PORank.addRank(Result input)
Reads the output tuple from POCounter and the cumulative sum previously calculated.
|
Modifier and Type | Method and Description |
---|---|
protected Tuple |
POLocalRearrange.constructLROutput(List<Result> resLst,
List<Result> secondaryResLst,
Tuple value) |
protected Tuple |
POLocalRearrange.constructLROutput(List<Result> resLst,
List<Result> secondaryResLst,
Tuple value) |
protected Tuple |
POPreCombinerLocalRearrange.constructLROutput(List<Result> resLst,
Tuple value) |
protected Tuple |
POCollectedGroup.constructOutput(List<Result> resLst,
Tuple value) |
protected DataBag |
POPartitionRearrange.constructPROutput(List<Result> resLst,
Tuple value) |
protected Object |
POLocalRearrange.getKeyFromResult(List<Result> resLst,
byte type) |
Modifier and Type | Method and Description |
---|---|
Result |
POPoissonSampleSpark.getNextTuple() |
Modifier and Type | Method and Description |
---|---|
Result |
BloomPackager.getNext() |
Result |
POValueOutputTez.getNextTuple() |
Result |
POValueInputTez.getNextTuple() |
Result |
POStoreTez.getNextTuple() |
Result |
POSimpleTezLoad.getNextTuple()
Previously, we reused the same Result object for all results, but we found
certain operators (e.g.
|
Result |
POShuffledValueInputTez.getNextTuple() |
Result |
POShuffleTezLoad.getNextTuple() |
Result |
PORankTez.getNextTuple() |
Result |
POPartitionRearrangeTez.getNextTuple()
Calls getNext on the generate operator inside the nested physical plan.
|
Result |
POLocalRearrangeTez.getNextTuple() |
Result |
POIdentityInOutTez.getNextTuple() |
Result |
POCounterTez.getNextTuple() |
Result |
POCounterStatsTez.getNextTuple() |
Result |
POBuildBloomRearrangeTez.getNextTuple() |
Result |
POBloomFilterRearrangeTez.getNextTuple() |
protected Result |
POLocalRearrangeTez.getRearrangedTuple() |
Modifier and Type | Method and Description |
---|---|
protected DataBag |
POPartitionRearrangeTez.constructPROutput(List<Result> resLst,
Tuple value) |
Copyright © 2007-2017 The Apache Software Foundation