org.apache.hadoop.mapreduce.lib.input

クラス FileSplit

java.lang.Object

org.apache.hadoop.mapreduce.InputSplit

org.apache.hadoop.mapreduce.lib.input.FileSplit

すべての実装されたインタフェース:

Writable

@InterfaceAudience.Public
 @InterfaceStability.Stable
public class FileSplit
extends InputSplit
implements Writable

A section of an input file. Returned by InputFormat.getSplits(JobContext) and passed to InputFormat.createRecordReader(InputSplit,TaskAttemptContext).

コンストラクタのサマリー

コンストラクタ

コンストラクタと説明
FileSplit()
FileSplit(Path file, long start, long length, String[] hosts) Constructs a split with host information
FileSplit(Path file, long start, long length, String[] hosts, String[] inMemoryHosts) Constructs a split with host and cached-blocks information

メソッドのサマリー

修飾子とタイプ	メソッドと説明
long	getLength() The number of bytes in the file to process.
SplitLocationInfo[]	getLocationInfo() Gets info about which nodes the input split is stored on and how it is stored at each location.
String[]	getLocations() Get the list of nodes by name where the data for the split would be local.
Path	getPath() The file containing this split's data.
long	getStart() The position of the first byte in the file to process.
void	readFields(DataInput in) Deserialize the fields of this object from in.
String	toString()
void	write(DataOutput out) Serialize the fields of this object to out.

クラスから継承されたメソッド java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

コンストラクタの詳細

FileSplit

public FileSplit()

FileSplit

public FileSplit(Path file,
                 long start,
                 long length,
                 String[] hosts)

Constructs a split with host information

パラメータ:

file - the file name

start - the position of the first byte in the file to process

length - the number of bytes in the file to process

hosts - the list of hosts containing the block, possibly null

FileSplit

public FileSplit(Path file,
                 long start,
                 long length,
                 String[] hosts,
                 String[] inMemoryHosts)

Constructs a split with host and cached-blocks information

パラメータ:

file - the file name

start - the position of the first byte in the file to process

length - the number of bytes in the file to process

hosts - the list of hosts containing the block

inMemoryHosts - the list of hosts containing the block in memory

メソッドの詳細

getPath

public Path getPath()

The file containing this split's data.

getStart

public long getStart()

The position of the first byte in the file to process.

getLength

public long getLength()

The number of bytes in the file to process.

定義:

getLength クラス内 InputSplit

戻り値:

the number of bytes in the split

toString

public String toString()

オーバーライド:

toString クラス内 Object

write

public void write(DataOutput out)
           throws IOException

インタフェースからコピーされた説明: Writable

Serialize the fields of this object to out.

定義:

write インタフェース内 Writable

パラメータ:

out - DataOuput to serialize this object into.

例外:

IOException

readFields

public void readFields(DataInput in)
                throws IOException

インタフェースからコピーされた説明: Writable

Deserialize the fields of this object from in.

For efficiency, implementations should attempt to re-use storage in the existing object where possible.

定義:

readFields インタフェース内 Writable

パラメータ:

in - DataInput to deseriablize this object from.

例外:

IOException

getLocations

public String[] getLocations()
                      throws IOException

クラスからコピーされた説明: InputSplit

Get the list of nodes by name where the data for the split would be local. The locations do not need to be serialized.

定義:

getLocations クラス内 InputSplit

戻り値:

a new array of the node nodes.

例外:

IOException

getLocationInfo

@InterfaceStability.Evolving
public SplitLocationInfo[] getLocationInfo()
                                                                 throws IOException

クラスからコピーされた説明: InputSplit

Gets info about which nodes the input split is stored on and how it is stored at each location.

オーバーライド:

getLocationInfo クラス内 InputSplit

戻り値:

list of SplitLocationInfos describing how the split data is stored at each location. A null value indicates that all the locations have the data stored on disk.

例外:

IOException