org.apache.hadoop.mapreduce.lib.output

クラス PartialFileOutputCommitter

java.lang.Object

org.apache.hadoop.mapreduce.OutputCommitter

org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

org.apache.hadoop.mapreduce.lib.output.PartialFileOutputCommitter

すべての実装されたインタフェース:

PartialOutputCommitter

@Checkpointable
 @InterfaceAudience.Public
 @InterfaceStability.Evolving
public class PartialFileOutputCommitter
extends FileOutputCommitter
implements PartialOutputCommitter

An OutputCommitter that commits files specified in job output directory i.e. ${mapreduce.output.fileoutputformat.outputdir}.

フィールドのサマリー

クラスから継承されたフィールド org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

FILEOUTPUTCOMMITTER_ALGORITHM_VERSION, FILEOUTPUTCOMMITTER_ALGORITHM_VERSION_DEFAULT, FILEOUTPUTCOMMITTER_CLEANUP_FAILURES_IGNORED, FILEOUTPUTCOMMITTER_CLEANUP_FAILURES_IGNORED_DEFAULT, FILEOUTPUTCOMMITTER_CLEANUP_SKIPPED, FILEOUTPUTCOMMITTER_CLEANUP_SKIPPED_DEFAULT, FILEOUTPUTCOMMITTER_FAILURE_ATTEMPTS, FILEOUTPUTCOMMITTER_FAILURE_ATTEMPTS_DEFAULT, PENDING_DIR_NAME, SUCCEEDED_FILE_NAME, SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, TEMP_DIR_NAME

コンストラクタのサマリー

コンストラクタ

コンストラクタと説明
PartialFileOutputCommitter(Path outputPath, JobContext context)
PartialFileOutputCommitter(Path outputPath, TaskAttemptContext context)

メソッドのサマリー

修飾子とタイプ	メソッドと説明
void	cleanUpPartialOutputForTask(TaskAttemptContext context) Remove all previously committed outputs from prior executions of this task.
Path	getCommittedTaskPath(int appAttemptId, TaskAttemptContext context) Compute the path where the output of a committed task is stored until the entire job is committed for a specific application attempt.

クラスから継承されたメソッド org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

abortJob, abortTask, cleanupJob, commitJob, commitJobInternal, commitTask, getCommittedTaskPath, getCommittedTaskPath, getJobAttemptPath, getJobAttemptPath, getJobAttemptPath, getTaskAttemptPath, getTaskAttemptPath, getWorkPath, isCommitJobRepeatable, isRecoverySupported, needsTaskCommit, recoverTask, setupJob, setupTask

クラスから継承されたメソッド org.apache.hadoop.mapreduce.OutputCommitter

isRecoverySupported

クラスから継承されたメソッド java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

コンストラクタの詳細

PartialFileOutputCommitter

public PartialFileOutputCommitter(Path outputPath,
                                  TaskAttemptContext context)
                           throws IOException

例外:

IOException

PartialFileOutputCommitter

public PartialFileOutputCommitter(Path outputPath,
                                  JobContext context)
                           throws IOException

例外:

IOException

メソッドの詳細

getCommittedTaskPath

public Path getCommittedTaskPath(int appAttemptId,
                                 TaskAttemptContext context)

クラスからコピーされた説明: FileOutputCommitter

Compute the path where the output of a committed task is stored until the entire job is committed for a specific application attempt.

オーバーライド:

getCommittedTaskPath クラス内 FileOutputCommitter

パラメータ:

appAttemptId - the id of the application attempt to use

context - the context of any task.

戻り値:

the path where the output of a committed task is stored.

cleanUpPartialOutputForTask

public void cleanUpPartialOutputForTask(TaskAttemptContext context)
                                 throws IOException

インタフェースからコピーされた説明: PartialOutputCommitter

Remove all previously committed outputs from prior executions of this task.

定義:

cleanUpPartialOutputForTask インタフェース内 PartialOutputCommitter

パラメータ:

context - Context for cleaning up previously promoted output.

例外:

IOException - If cleanup fails, then the state of the task my not be well defined.