@InterfaceAudience.Public @InterfaceStability.Stable public class FilterOutputFormat<K,V> extends OutputFormat<K,V>
| Modifier and Type | Field and Description |
|---|---|
protected OutputFormat<K,V> |
baseOut |
| Constructor and Description |
|---|
FilterOutputFormat() |
FilterOutputFormat(OutputFormat<K,V> baseOut)
Create a FilterOutputFormat based on the underlying output format.
|
| Modifier and Type | Method and Description |
|---|---|
void |
checkOutputSpecs(JobContext context)
Check for validity of the output-specification for the job.
|
OutputCommitter |
getOutputCommitter(TaskAttemptContext context)
Get the output committer for this output format.
|
RecordWriter<K,V> |
getRecordWriter(TaskAttemptContext context)
Get the
RecordWriter for the given task. |
protected OutputFormat<K,V> baseOut
public FilterOutputFormat()
public FilterOutputFormat(OutputFormat<K,V> baseOut)
baseOut - the underlying OutputFormatpublic RecordWriter<K,V> getRecordWriter(TaskAttemptContext context) throws IOException, InterruptedException
OutputFormatRecordWriter for the given task.getRecordWriter in class OutputFormat<K,V>context - the information about the current task.RecordWriter to write the output for the job.IOExceptionInterruptedExceptionpublic void checkOutputSpecs(JobContext context) throws IOException, InterruptedException
OutputFormatThis is to validate the output specification for the job when it is a job is submitted. Typically checks that it does not already exist, throwing an exception when it already exists, so that output is not overwritten.
Implementations which write to filesystems which support delegation tokens usually collect the tokens for the destination path(s) and attach them to the job context's JobConf.checkOutputSpecs in class OutputFormat<K,V>context - information about the jobIOException - when output should not be attemptedInterruptedExceptionpublic OutputCommitter getOutputCommitter(TaskAttemptContext context) throws IOException, InterruptedException
OutputFormatgetOutputCommitter in class OutputFormat<K,V>context - the task contextIOExceptionInterruptedExceptionCopyright © 2023 Apache Software Foundation. All rights reserved.