public class ColumnEncoderComposite extends ColumnEncoder
ColumnEncoder.EncoderType| Constructor and Description |
|---|
ColumnEncoderComposite() |
ColumnEncoderComposite(ColumnEncoder columnEncoder) |
ColumnEncoderComposite(List<ColumnEncoder> columnEncoders) |
ColumnEncoderComposite(List<ColumnEncoder> columnEncoders,
FrameBlock meta) |
| Modifier and Type | Method and Description |
|---|---|
void |
addEncoder(ColumnEncoder other) |
MatrixBlock |
apply(FrameBlock in,
MatrixBlock out,
int outputCol)
Apply the generated metadata to the FrameBlock and saved the result in out.
|
MatrixBlock |
apply(FrameBlock in,
MatrixBlock out,
int outputCol,
int rowStart,
int blk) |
MatrixBlock |
apply(MatrixBlock in,
MatrixBlock out,
int outputCol) |
MatrixBlock |
apply(MatrixBlock in,
MatrixBlock out,
int outputCol,
int rowStart,
int blk) |
void |
build(FrameBlock in)
Build the transform meta data for the given block input.
|
void |
buildPartial(FrameBlock in)
Partial build of internal data structures (e.g., in distributed spark operations).
|
boolean |
equals(Object o) |
<T extends ColumnEncoder> |
getEncoder(Class<T> type) |
List<ColumnEncoder> |
getEncoders() |
FrameBlock |
getMetaData(FrameBlock out)
Construct a frame block out of the transform meta data.
|
List<Callable<Object>> |
getPartialBuildTasks(FrameBlock in,
int blockSize) |
<T extends ColumnEncoder> |
hasEncoder(Class<T> type) |
int |
hashCode() |
void |
initMetaData(FrameBlock out)
Sets up the required meta data for a subsequent call to apply.
|
boolean |
isEncoder(int colID,
Class<?> type) |
void |
mergeAt(ColumnEncoder other)
Merges another encoder, of a compatible type, in after a certain position.
|
void |
mergeBuildPartial(List<Future<Object>> futurePartials,
int start,
int end) |
void |
prepareBuildPartial()
Allocates internal data structures for partial build.
|
void |
readExternal(ObjectInput in)
Redirects the default java serialization via externalizable to our default hadoop writable serialization for
efficient broadcast/rdd deserialization.
|
void |
shiftCol(int columnOffset) |
String |
toString() |
void |
updateIndexRanges(long[] beginDims,
long[] endDims,
int colOffset)
Update index-ranges to after encoding.
|
void |
writeExternal(ObjectOutput out)
Redirects the default java serialization via externalizable to our default hadoop writable serialization for
efficient broadcast/rdd serialization.
|
compareTo, getColID, getColMapping, isApplicable, isApplicable, setColIDpublic ColumnEncoderComposite()
public ColumnEncoderComposite(List<ColumnEncoder> columnEncoders, FrameBlock meta)
public ColumnEncoderComposite(List<ColumnEncoder> columnEncoders)
public ColumnEncoderComposite(ColumnEncoder columnEncoder)
public List<ColumnEncoder> getEncoders()
public <T extends ColumnEncoder> T getEncoder(Class<T> type)
public boolean isEncoder(int colID,
Class<?> type)
public void build(FrameBlock in)
Encoderin - input frame blockpublic List<Callable<Object>> getPartialBuildTasks(FrameBlock in, int blockSize)
getPartialBuildTasks in class ColumnEncoderpublic void mergeBuildPartial(List<Future<Object>> futurePartials, int start, int end) throws ExecutionException, InterruptedException
mergeBuildPartial in class ColumnEncoderExecutionExceptionInterruptedExceptionpublic void prepareBuildPartial()
ColumnEncoderprepareBuildPartial in interface EncoderprepareBuildPartial in class ColumnEncoderpublic void buildPartial(FrameBlock in)
ColumnEncoderbuildPartial in interface EncoderbuildPartial in class ColumnEncoderin - input frame blockpublic MatrixBlock apply(FrameBlock in, MatrixBlock out, int outputCol)
Encoderin - input frame blockout - output matrix blockoutputCol - is a offset in the output matrix. column in FrameBlock + outputCol = column in outpublic MatrixBlock apply(MatrixBlock in, MatrixBlock out, int outputCol)
apply in class ColumnEncoderpublic MatrixBlock apply(FrameBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)
apply in class ColumnEncoderpublic MatrixBlock apply(MatrixBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)
apply in class ColumnEncoderpublic void mergeAt(ColumnEncoder other)
ColumnEncoderColumnEncoders are compatible with themselves and EncoderComposite is compatible with
every other ColumnEncoders. MultiColumnEncoders are compatible with every encodermergeAt in class ColumnEncoderother - the encoder that should be merged inpublic void addEncoder(ColumnEncoder other)
public void updateIndexRanges(long[] beginDims,
long[] endDims,
int colOffset)
ColumnEncoderupdateIndexRanges in interface EncoderupdateIndexRanges in class ColumnEncoderbeginDims - begin dimensions of rangeendDims - end dimensions of rangecolOffset - is applied to begin and endDimspublic FrameBlock getMetaData(FrameBlock out)
Encoderout - output frame blockpublic void initMetaData(FrameBlock out)
Encoderout - frame blockpublic void writeExternal(ObjectOutput out) throws IOException
ColumnEncoderwriteExternal in interface ExternalizablewriteExternal in class ColumnEncoderout - object outputIOException - if IOException occurspublic void readExternal(ObjectInput in) throws IOException
ColumnEncoderreadExternal in interface ExternalizablereadExternal in class ColumnEncoderin - object inputIOException - if IOException occurpublic <T extends ColumnEncoder> boolean hasEncoder(Class<T> type)
public void shiftCol(int columnOffset)
shiftCol in class ColumnEncoderCopyright © 2021 The Apache Software Foundation. All rights reserved.