Package | Description |
---|---|
org.apache.pig |
Public interfaces and classes for Pig.
|
org.apache.pig.impl.util | |
org.apache.pig.newplan.logical | |
org.apache.pig.newplan.logical.optimizer | |
org.apache.pig.newplan.logical.relational | |
org.apache.pig.newplan.logical.rules | |
org.apache.pig.parser | |
org.apache.pig.pen |
Constructor and Description |
---|
ResourceSchema(LogicalSchema pigSchema)
Construct a ResourceSchema from a
LogicalSchema |
ResourceSchema(LogicalSchema pigSchema,
SortInfo sortInfo)
Only for use by Pig internal code.
|
Modifier and Type | Method and Description |
---|---|
static LogicalSchema |
Utils.parseSchema(String schemaString) |
Modifier and Type | Method and Description |
---|---|
static LogicalSchema |
Util.translateSchema(Schema schema) |
Modifier and Type | Method and Description |
---|---|
static Schema |
Util.translateSchema(LogicalSchema schema)
This function translates the new LogicalSchema into old Schema format required
by PhysicalOperators
|
Modifier and Type | Method and Description |
---|---|
void |
SchemaResetter.validate(LogicalSchema schema)
Check if schema is valid (ready to be part of a final logical plan)
|
Modifier and Type | Field and Description |
---|---|
LogicalSchema |
LogicalSchema.LogicalFieldSchema.schema |
protected LogicalSchema |
LogicalRelationalOperator.schema |
Modifier and Type | Method and Description |
---|---|
LogicalSchema |
LogicalSchema.deepCopy() |
LogicalSchema |
LOForEach.dumpNestedSchema(String alias,
String nestedAlias) |
LogicalSchema |
LOLoad.getDeterminedSchema() |
abstract LogicalSchema |
LogicalRelationalOperator.getSchema()
Get the schema for the output of this relational operator.
|
LogicalSchema |
LOUnion.getSchema() |
LogicalSchema |
LOStream.getSchema() |
LogicalSchema |
LOStore.getSchema() |
LogicalSchema |
LOSplitOutput.getSchema() |
LogicalSchema |
LOSplit.getSchema() |
LogicalSchema |
LOSort.getSchema() |
LogicalSchema |
LORank.getSchema()
Get the schema for the output of LORank.
|
LogicalSchema |
LONative.getSchema() |
LogicalSchema |
LOLoad.getSchema()
Get the schema for this load.
|
LogicalSchema |
LOLimit.getSchema() |
LogicalSchema |
LOJoin.getSchema() |
LogicalSchema |
LOInnerLoad.getSchema() |
LogicalSchema |
LOGenerate.getSchema() |
LogicalSchema |
LOForEach.getSchema() |
LogicalSchema |
LOFilter.getSchema() |
LogicalSchema |
LODistinct.getSchema() |
LogicalSchema |
LOCube.getSchema() |
LogicalSchema |
LOCross.getSchema() |
LogicalSchema |
LOCogroup.getSchema() |
LogicalSchema |
LOStream.getScriptSchema() |
LogicalSchema |
LOLoad.getScriptSchema() |
static LogicalSchema |
LogicalSchema.merge(LogicalSchema s1,
LogicalSchema s2,
LogicalSchema.MergeMode mode)
Merge two schemas.
|
static LogicalSchema |
LogicalSchema.mergeSchemaByAlias(LogicalSchema schema1,
LogicalSchema schema2)
Merges two schemas using their column aliases
(unlike mergeSchema(..) functions which merge using positions)
Schema will not be merged if types are incompatible,
as per DataType.mergeType(..)
For Tuples and Bags, SubSchemas have to be equal be considered compatible
|
static LogicalSchema |
LogicalSchema.mergeSchemasByAlias(List<LogicalSchema> schemas)
Merges collection of schemas using their column aliases
(unlike mergeSchema(..) functions which merge using positions)
Schema will not be merged if types are incompatible,
as per DataType.mergeType(..)
For Tuples and Bags, SubSchemas have to be equal be considered compatible
|
LogicalSchema |
LogicalSchema.mergeUid(LogicalSchema uidOnlySchema) |
Modifier and Type | Method and Description |
---|---|
List<LogicalSchema> |
LOGenerate.getExpSchemas() |
List<LogicalSchema> |
LOGenerate.getOutputPlanSchemas()
Get the output schema corresponding to each input expression plan
|
List<LogicalSchema> |
LOGenerate.getUidOnlySchemas() |
List<LogicalSchema> |
LOGenerate.getUserDefinedSchema() |
Modifier and Type | Method and Description |
---|---|
static boolean |
LogicalSchema.castable(LogicalSchema inSch,
LogicalSchema outSch)
Recursively compare two schemas to check if the input schema
can be cast to the cast schema
|
static boolean |
LogicalSchema.equals(LogicalSchema schema,
LogicalSchema other,
boolean relaxInner,
boolean relaxAlias)
Recursively compare two schemas for equality
|
static boolean |
LogicalSchema.isEqualUnlessUnknown(LogicalSchema s1,
LogicalSchema s2) |
static LogicalSchema |
LogicalSchema.merge(LogicalSchema s1,
LogicalSchema s2,
LogicalSchema.MergeMode mode)
Merge two schemas.
|
static LogicalSchema |
LogicalSchema.mergeSchemaByAlias(LogicalSchema schema1,
LogicalSchema schema2)
Merges two schemas using their column aliases
(unlike mergeSchema(..) functions which merge using positions)
Schema will not be merged if types are incompatible,
as per DataType.mergeType(..)
For Tuples and Bags, SubSchemas have to be equal be considered compatible
|
LogicalSchema |
LogicalSchema.mergeUid(LogicalSchema uidOnlySchema) |
void |
LogicalRelationalOperator.neverUseForRealSetSchema(LogicalSchema schema)
Only to be used by unit tests.
|
void |
LogicalRelationalOperator.setSchema(LogicalSchema schema) |
void |
LOLoad.setScriptSchema(LogicalSchema schema) |
Modifier and Type | Method and Description |
---|---|
static LogicalSchema |
LogicalSchema.mergeSchemasByAlias(List<LogicalSchema> schemas)
Merges collection of schemas using their column aliases
(unlike mergeSchema(..) functions which merge using positions)
Schema will not be merged if types are incompatible,
as per DataType.mergeType(..)
For Tuples and Bags, SubSchemas have to be equal be considered compatible
|
void |
LOGenerate.setOutputPlanSchemas(List<LogicalSchema> outputPlanSchemas) |
void |
LOGenerate.setUidOnlySchemas(List<LogicalSchema> uidOnlySchemas) |
void |
LOGenerate.setUserDefinedSchema(List<LogicalSchema> userDefinedSchema) |
Constructor and Description |
---|
LogicalFieldSchema(String alias,
LogicalSchema schema,
byte type) |
LogicalFieldSchema(String alias,
LogicalSchema schema,
byte type,
long uid) |
LOLoad(FileSpec loader,
LogicalSchema schema,
LogicalPlan plan,
org.apache.hadoop.conf.Configuration conf,
LoadFunc loadFunc,
String signature)
Used from the LogicalPlanBuilder
|
LOLoad(LogicalSchema schema,
LogicalPlan plan)
used for pattern matching
|
LOStream(LogicalPlan plan,
ExecutableManager exeManager,
StreamingCommand cmd,
LogicalSchema schema) |
Modifier and Type | Method and Description |
---|---|
protected abstract LogicalSchema |
TypeCastInserter.determineSchema(LogicalRelationalOperator op) |
protected LogicalSchema |
StreamTypeCastInserter.determineSchema(LogicalRelationalOperator op) |
protected LogicalSchema |
LoadTypeCastInserter.determineSchema(LogicalRelationalOperator op)
if we are inserting casts in a load and if the loader implements
determineSchema(), insert casts only where necessary Note that in this
case, the data coming out of the loader is not a BYTEARRAY but is
whatever determineSchema() says it is.
|
Modifier and Type | Method and Description |
---|---|
protected Set<Integer> |
ColumnPruneHelper.getColumns(LogicalSchema schema,
Set<Long> uids) |
Modifier and Type | Method and Description |
---|---|
LogicalSchema |
QueryParserDriver.parseSchema(String input) |
Modifier and Type | Method and Description |
---|---|
LogicalSchema |
Illustrator.getSchema() |
Constructor and Description |
---|
Illustrator(LineageTracer lineage,
LinkedList<IdentityHashSet<Tuple>> equivalenceClasses,
int maxRecords,
IllustratorAttacher attacher,
LogicalSchema schema,
PigContext hadoopPigContext) |
Constructor and Description |
---|
IllustratorAttacher(PhysicalPlan plan,
LineageTracer lineage,
int maxRecords,
Map<POLoad,LogicalSchema> poLoadToSchemaMap,
PigContext hadoopPigContext) |
Copyright © 2007-2017 The Apache Software Foundation