org.apache.pig.backend.hadoop.executionengine.tez.runtime

Interface TezInput

All Known Implementing Classes:

POBloomFilterRearrangeTez, POCounterStatsTez, POFRJoinTez, POIdentityInOutTez, PORankTez, POShuffledValueInputTez, POShuffleTezLoad, POSimpleTezLoad, POValueInputTez, ReadScalarsTez

public interface TezInput

This interface is implemented by PhysicalOperators that can have Tez inputs attached directly to the operator.

Method Summary

Modifier and Type	Method and Description
void	addInputsToSkip(Set<String> inputsToSkip) Add to the list of inputs to skip download if already available in vertex cache
void	attachInputs(Map<String,org.apache.tez.runtime.api.LogicalInput> inputs, org.apache.hadoop.conf.Configuration conf) Attach the inputs to the operator.
String[]	getTezInputs()
void	replaceInput(String oldInputKey, String newInputKey)

Method Detail

getTezInputs

String[] getTezInputs()

replaceInput

void replaceInput(String oldInputKey,
                  String newInputKey)

addInputsToSkip

void addInputsToSkip(Set<String> inputsToSkip)

Add to the list of inputs to skip download if already available in vertex cache

Parameters:

inputsToSkip -

attachInputs

void attachInputs(Map<String,org.apache.tez.runtime.api.LogicalInput> inputs,
                  org.apache.hadoop.conf.Configuration conf)
           throws ExecException

Attach the inputs to the operator. Also ensure reader.next() is called to force fetch the input so that all inputs are fetched and memory released before memory is allocated for outputs

Parameters:

inputs - available inputs

conf - configuration

Throws:

ExecException