org.apache.hadoop.mapred

クラス FileSplit

java.lang.Object

org.apache.hadoop.mapreduce.InputSplit

org.apache.hadoop.mapred.FileSplit

すべての実装されたインタフェース:

Writable, InputSplit, InputSplitWithLocationInfo

@InterfaceAudience.Public
 @InterfaceStability.Stable
public class FileSplit
extends InputSplit
implements InputSplitWithLocationInfo

A section of an input file. Returned by InputFormat.getSplits(JobConf, int) and passed to InputFormat.getRecordReader(InputSplit,JobConf,Reporter).

コンストラクタのサマリー

コンストラクタ

修飾子	コンストラクタと説明
protected	FileSplit()
	FileSplit(FileSplit fs)
	FileSplit(Path file, long start, long length, JobConf conf) 非推奨です。
	FileSplit(Path file, long start, long length, String[] hosts) Constructs a split with host information
	FileSplit(Path file, long start, long length, String[] hosts, String[] inMemoryHosts) Constructs a split with host information

メソッドのサマリー

修飾子とタイプ	メソッドと説明
long	getLength() The number of bytes in the file to process.
SplitLocationInfo[]	getLocationInfo() Gets info about which nodes the input split is stored on and how it is stored at each location.
String[]	getLocations() Get the list of nodes by name where the data for the split would be local.
Path	getPath() The file containing this split's data.
long	getStart() The position of the first byte in the file to process.
void	readFields(DataInput in) Deserialize the fields of this object from in.
String	toString()
void	write(DataOutput out) Serialize the fields of this object to out.

クラスから継承されたメソッド java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

コンストラクタの詳細

FileSplit

protected FileSplit()

FileSplit

@Deprecated
public FileSplit(Path file,
                             long start,
                             long length,
                             JobConf conf)

非推奨です。

Constructs a split.

パラメータ:

file - the file name

start - the position of the first byte in the file to process

length - the number of bytes in the file to process

FileSplit

public FileSplit(Path file,
                 long start,
                 long length,
                 String[] hosts)

Constructs a split with host information

パラメータ:

file - the file name

start - the position of the first byte in the file to process

length - the number of bytes in the file to process

hosts - the list of hosts containing the block, possibly null

FileSplit

public FileSplit(Path file,
                 long start,
                 long length,
                 String[] hosts,
                 String[] inMemoryHosts)

Constructs a split with host information

パラメータ:

file - the file name

start - the position of the first byte in the file to process

length - the number of bytes in the file to process

hosts - the list of hosts containing the block, possibly null

inMemoryHosts - the list of hosts containing the block in memory

FileSplit

public FileSplit(FileSplit fs)

メソッドの詳細

getPath

public Path getPath()

The file containing this split's data.

getStart

public long getStart()

The position of the first byte in the file to process.

getLength

public long getLength()

The number of bytes in the file to process.

定義:

getLength インタフェース内 InputSplit

定義:

getLength クラス内 InputSplit

戻り値:

the number of bytes in the split

toString

public String toString()

オーバーライド:

toString クラス内 Object

write

public void write(DataOutput out)
           throws IOException

インタフェースからコピーされた説明: Writable

Serialize the fields of this object to out.

定義:

write インタフェース内 Writable

パラメータ:

out - DataOuput to serialize this object into.

例外:

IOException

readFields

public void readFields(DataInput in)
                throws IOException

インタフェースからコピーされた説明: Writable

Deserialize the fields of this object from in.

For efficiency, implementations should attempt to re-use storage in the existing object where possible.

定義:

readFields インタフェース内 Writable

パラメータ:

in - DataInput to deseriablize this object from.

例外:

IOException

getLocations

public String[] getLocations()
                      throws IOException

クラスからコピーされた説明: InputSplit

Get the list of nodes by name where the data for the split would be local. The locations do not need to be serialized.

定義:

getLocations インタフェース内 InputSplit

定義:

getLocations クラス内 InputSplit

戻り値:

a new array of the node nodes.

例外:

IOException

getLocationInfo

@InterfaceStability.Evolving
public SplitLocationInfo[] getLocationInfo()
                                                                 throws IOException

クラスからコピーされた説明: InputSplit

Gets info about which nodes the input split is stored on and how it is stored at each location.

定義:

getLocationInfo インタフェース内 InputSplitWithLocationInfo

オーバーライド:

getLocationInfo クラス内 InputSplit

戻り値:

list of SplitLocationInfos describing how the split data is stored at each location. A null value indicates that all the locations have the data stored on disk.

例外:

IOException