org.apache.hadoop.mapreduce.v2.hs

クラス HistoryFileManager

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager

すべての実装されたインタフェース:

Closeable, AutoCloseable, Service

@InterfaceAudience.Public
 @InterfaceStability.Unstable
public class HistoryFileManager
extends AbstractService

This class provides a way to interact with history files in a thread safe manor.

フィールドのサマリー

フィールド

修飾子とタイプ	フィールドと説明
protected org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.JobListCache	jobListCache
protected ThreadPoolExecutor	moveToDoneExecutor

コンストラクタのサマリー

コンストラクタ

コンストラクタと説明
HistoryFileManager()

メソッドのサマリー

修飾子とタイプ	メソッドと説明
protected org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.HistoryFileInfo	createHistoryFileInfo(Path historyFile, Path confFile, Path summaryFile, org.apache.hadoop.mapreduce.v2.jobhistory.JobIndexInfo jobIndexInfo, boolean isInDone)
protected org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.JobListCache	createJobListCache()
protected ThreadPoolExecutor	createMoveToDoneThreadPool(int numMoveThreads)
protected boolean	deleteDir(FileStatus serialDir)
protected List<FileStatus>	findTimestampedDirectories() Finds all history directories with a timestamp component by scanning the filesystem.
Collection<org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.HistoryFileInfo>	getAllFileInfo()
org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.HistoryFileInfo	getFileInfo(org.apache.hadoop.mapreduce.v2.api.records.JobId jobId)
protected static List<FileStatus>	scanDirectory(Path path, FileContext fc, PathFilter pathFilter)
protected List<FileStatus>	scanDirectoryForHistoryFiles(Path path, FileContext fc)
protected void	serviceInit(Configuration conf) All initialization code needed by a service.
void	serviceStop() Actions called during the transition to the STOPPED state.

クラスから継承されたメソッド org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, serviceStart, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

クラスから継承されたメソッド java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

フィールドの詳細

jobListCache

protected org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.JobListCache jobListCache

moveToDoneExecutor

protected ThreadPoolExecutor moveToDoneExecutor

コンストラクタの詳細

HistoryFileManager

public HistoryFileManager()

メソッドの詳細

serviceInit

protected void serviceInit(Configuration conf)
                    throws Exception

クラスからコピーされた説明: AbstractService

All initialization code needed by a service. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.init(Configuration) prevents re-entrancy. The base implementation checks to see if the subclass has created a new configuration instance, and if so, updates the base class value

オーバーライド:

serviceInit クラス内 AbstractService

パラメータ:

conf - configuration

例外:

Exception - on a failure -these will be caught, possibly wrapped, and wil; trigger a service stop

createMoveToDoneThreadPool

protected ThreadPoolExecutor createMoveToDoneThreadPool(int numMoveThreads)

serviceStop

public void serviceStop()
                 throws Exception

クラスからコピーされた説明: AbstractService

Actions called during the transition to the STOPPED state. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.stop() prevents re-entrancy. Implementations MUST write this to be robust against failures, including checks for null references -and for the first failure to not stop other attempts to shut down parts of the service.

オーバーライド:

serviceStop クラス内 AbstractService

例外:

Exception - if needed -these will be caught and logged.

createJobListCache

protected org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.JobListCache createJobListCache()

createHistoryFileInfo

protected org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.HistoryFileInfo createHistoryFileInfo(Path historyFile,
                                                                                                     Path confFile,
                                                                                                     Path summaryFile,
                                                                                                     org.apache.hadoop.mapreduce.v2.jobhistory.JobIndexInfo jobIndexInfo,
                                                                                                     boolean isInDone)

scanDirectory

protected static List<FileStatus> scanDirectory(Path path,
                                                FileContext fc,
                                                PathFilter pathFilter)
                                         throws IOException

例外:

IOException

scanDirectoryForHistoryFiles

protected List<FileStatus> scanDirectoryForHistoryFiles(Path path,
                                                        FileContext fc)
                                                 throws IOException

例外:

IOException

findTimestampedDirectories

protected List<FileStatus> findTimestampedDirectories()
                                               throws IOException

Finds all history directories with a timestamp component by scanning the filesystem. Used when the JobHistory server is started.

戻り値:

list of history directories

例外:

IOException

getAllFileInfo

public Collection<org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.HistoryFileInfo> getAllFileInfo()
                                                                                                throws IOException

例外:

IOException

getFileInfo

public org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.HistoryFileInfo getFileInfo(org.apache.hadoop.mapreduce.v2.api.records.JobId jobId)
                                                                                 throws IOException

例外:

IOException

deleteDir

protected boolean deleteDir(FileStatus serialDir)
                     throws org.apache.hadoop.security.AccessControlException,
                            FileNotFoundException,
                            UnsupportedFileSystemException,
                            IOException

例外:

org.apache.hadoop.security.AccessControlException

FileNotFoundException

UnsupportedFileSystemException

IOException