org.apache.hadoop.mapred

クラス KeyValueTextInputFormat

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<Text,Text>

org.apache.hadoop.mapred.KeyValueTextInputFormat

すべての実装されたインタフェース:

InputFormat<Text,Text>, JobConfigurable

@InterfaceAudience.Public
 @InterfaceStability.Stable
public class KeyValueTextInputFormat
extends FileInputFormat<Text,Text>
implements JobConfigurable

An InputFormat for plain text files. Files are broken into lines. Either linefeed or carriage-return are used to signal end of line. Each line is divided into key and value parts by a separator byte. If no such a byte exists, the key will be the entire line and value will be empty.

フィールドのサマリー

クラスから継承されたフィールド org.apache.hadoop.mapred.FileInputFormat

INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES

コンストラクタのサマリー

コンストラクタ

コンストラクタと説明
KeyValueTextInputFormat()

メソッドのサマリー

修飾子とタイプ	メソッドと説明
void	configure(JobConf conf) Initializes a new instance from a JobConf.
RecordReader<Text,Text>	getRecordReader(InputSplit genericSplit, JobConf job, Reporter reporter) Get the RecordReader for the given InputSplit.
protected boolean	isSplitable(FileSystem fs, Path file) Is the given filename splittable?

クラスから継承されたメソッド org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, listStatus, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

クラスから継承されたメソッド java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

コンストラクタの詳細

KeyValueTextInputFormat

public KeyValueTextInputFormat()

メソッドの詳細

configure

public void configure(JobConf conf)

インタフェースからコピーされた説明: JobConfigurable

Initializes a new instance from a JobConf.

定義:

configure インタフェース内 JobConfigurable

パラメータ:

conf - the configuration

isSplitable

protected boolean isSplitable(FileSystem fs,
                              Path file)

クラスからコピーされた説明: FileInputFormat

Is the given filename splittable? Usually, true, but if the file is stream compressed, it will not be. The default implementation in FileInputFormat always returns true. Implementations that may deal with non-splittable files must override this method. FileInputFormat implementations can override this and return false to ensure that individual input files are never split-up so that Mappers process entire files.

オーバーライド:

isSplitable クラス内 FileInputFormat<Text,Text>

パラメータ:

fs - the file system that the file is on

file - the file name to check

戻り値:

is this file splitable?

getRecordReader

public RecordReader<Text,Text> getRecordReader(InputSplit genericSplit,
                                               JobConf job,
                                               Reporter reporter)
                                        throws IOException

インタフェースからコピーされた説明: InputFormat

Get the RecordReader for the given InputSplit.

It is the responsibility of the RecordReader to respect record boundaries while processing the logical split to present a record-oriented view to the individual task.

定義:

getRecordReader インタフェース内 InputFormat<Text,Text>

定義:

getRecordReader クラス内 FileInputFormat<Text,Text>

パラメータ:

genericSplit - the InputSplit

job - the job that this split belongs to

戻り値:

a RecordReader

例外:

IOException