クラスの使用
org.apache.hadoop.fs.FileSystem

FileSystemを使用しているパッケージ

パッケージ	説明
org.apache.hadoop.fs	Implementations of AbstractFileSystem for hdfs over rpc and hdfs over web.
org.apache.hadoop.fs.azure	A distributed implementation of FileSystem for reading and writing files on Azure Block Storage.
org.apache.hadoop.fs.ftp
org.apache.hadoop.fs.s3native	A distributed implementation of FileSystem for reading and writing files on Amazon S3.
org.apache.hadoop.fs.viewfs
org.apache.hadoop.io	Generic i/o code for use when reading and writing data to the network, to databases, and to files.
org.apache.hadoop.mapred
org.apache.hadoop.mapred.lib
org.apache.hadoop.mapred.lib.db
org.apache.hadoop.mapreduce
org.apache.hadoop.mapreduce.lib.input
org.apache.hadoop.metrics2.sink	Builtin metrics sinks

org.apache.hadoop.fsでのFileSystemの使用

org.apache.hadoop.fsでのFileSystemのサブクラス

修飾子とタイプ	クラスと説明
class	ChecksumFileSystem Abstract Checksumed FileSystem.
class	FilterFileSystem A FilterFileSystem contains some other file system, which it uses as its basic file system, possibly transforming the data along the way or providing additional functionality.
class	LocalFileSystem Implement the FileSystem API for the checksumed local filesystem.
class	RawLocalFileSystem Implement the FileSystem API for the raw local filesystem.

FileSystemとして宣言されているorg.apache.hadoop.fsのフィールド

修飾子とタイプ	フィールドと説明
protected FileSystem	TrashPolicy.fs
protected FileSystem	FilterFileSystem.fs

FileSystemを返すorg.apache.hadoop.fsのメソッド

修飾子とタイプ	メソッドと説明
static FileSystem	FileSystem.get(Configuration conf) Returns the configured filesystem implementation.
static FileSystem	FileSystem.get(URI uri, Configuration conf) Returns the FileSystem for this URI's scheme and authority.
static FileSystem	FileSystem.get(URI uri, Configuration conf, String user) Get a filesystem instance based on the uri, the passed configuration and the user
FileSystem[]	FilterFileSystem.getChildFileSystems()
FileSystem	Path.getFileSystem(Configuration conf) Return the FileSystem that owns this Path.
protected static FileSystem	FileSystem.getFSofPath(Path absOrFqPath, Configuration conf)
static FileSystem	FileSystem.getNamed(String name, Configuration conf) 非推奨です。 call #get(URI,Configuration) instead.
FileSystem	LocalFileSystem.getRaw()
FileSystem	FilterFileSystem.getRawFileSystem() Get the raw file system
FileSystem	ChecksumFileSystem.getRawFileSystem() get the raw file system
static FileSystem	FileSystem.newInstance(Configuration conf) Returns a unique configured filesystem implementation.
static FileSystem	FileSystem.newInstance(URI uri, Configuration conf) Returns the FileSystem for this URI's scheme and authority.
static FileSystem	FileSystem.newInstance(URI uri, Configuration conf, String user) Returns the FileSystem for this URI's scheme and authority and the passed user.

FileSystem型の引数を持つ型を返すorg.apache.hadoop.fsのメソッド

修飾子とタイプ	メソッドと説明
static Class<? extends FileSystem>	FileSystem.getFileSystemClass(String scheme, Configuration conf)

FileSystem型のパラメータを持つorg.apache.hadoop.fsのメソッド

修飾子とタイプ	メソッドと説明
static boolean	FileUtil.compareFs(FileSystem srcFs, FileSystem destFs)
static boolean	FileUtil.copy(File src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf) Copy local files to a FileSystem.
static boolean	FileUtil.copy(FileSystem srcFS, FileStatus srcStatus, FileSystem dstFS, Path dst, boolean deleteSource, boolean overwrite, Configuration conf) Copy files between FileSystems.
static boolean	FileUtil.copy(FileSystem srcFS, Path[] srcs, FileSystem dstFS, Path dst, boolean deleteSource, boolean overwrite, Configuration conf)
static boolean	FileUtil.copy(FileSystem srcFS, Path src, File dst, boolean deleteSource, Configuration conf) Copy FileSystem files to local files.
static boolean	FileUtil.copy(FileSystem srcFS, Path src, FileSystem dstFS, Path dst, boolean deleteSource, boolean overwrite, Configuration conf) Copy files between FileSystems.
static boolean	FileUtil.copy(FileSystem srcFS, Path src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf) Copy files between FileSystems.
static FSDataOutputStream	FileSystem.create(FileSystem fs, Path file, FsPermission permission) create a file with the provided permission The permission of the file is set to be the provided permission as in setPermission, not permission&~umask It is implemented using two RPCs.
static void	FileUtil.fullyDelete(FileSystem fs, Path dir) 非推奨です。 Use delete(Path, boolean)
static TrashPolicy	TrashPolicy.getInstance(Configuration conf, FileSystem fs) Get an instance of the configured TrashPolicy based on the value of the configuration parameter fs.trash.classname.
void	TrashPolicy.initialize(Configuration conf, FileSystem fs) Used to setup the trash policy.
Path	Path.makeQualified(FileSystem fs) 非推奨です。 use Path.makeQualified(URI, Path)
static boolean	FileSystem.mkdirs(FileSystem fs, Path dir, FsPermission permission) create a directory with the provided permission The permission of the directory is set to be the provided permission as in setPermission, not permission&~umask
static boolean	Trash.moveToAppropriateTrash(FileSystem fs, Path p, Configuration conf) In case of the symlinks or mount points, one has to move the appropriate trashbin in the actual volume of the path p being deleted.

FileSystem型の型引数を持つorg.apache.hadoop.fsのメソッド・パラメータ

修飾子とタイプ	メソッドと説明
static org.apache.hadoop.fs.FileSystem.Statistics	FileSystem.getStatistics(String scheme, Class<? extends FileSystem> cls) 非推奨です。 use getGlobalStorageStatistics()

FileSystem型のパラメータを持つorg.apache.hadoop.fsのコンストラクタ

コンストラクタと説明
ChecksumFileSystem(FileSystem fs)
FilterFileSystem(FileSystem fs)
LocalFileSystem(FileSystem rawLocalFileSystem)
Trash(FileSystem fs, Configuration conf) Construct a trash can accessor for the FileSystem provided.

org.apache.hadoop.fs.azureでのFileSystemの使用

org.apache.hadoop.fs.azureでのFileSystemのサブクラス

修飾子とタイプ	クラスと説明
class	NativeAzureFileSystem A FileSystem for reading and writing files stored on Windows Azure.

FileSystem型のパラメータを持つorg.apache.hadoop.fs.azureのメソッド

修飾子とタイプ	メソッドと説明
void	WasbFsck.setMockFileSystemForTesting(FileSystem fileSystem) For testing purposes, set the file system to use here instead of relying on getting it from the FileSystem class based on the URI.

org.apache.hadoop.fs.ftpでのFileSystemの使用

org.apache.hadoop.fs.ftpでのFileSystemのサブクラス

修飾子とタイプ	クラスと説明
class	FTPFileSystem A FileSystem backed by an FTP client provided by Apache Commons Net.

org.apache.hadoop.fs.s3nativeでのFileSystemの使用

org.apache.hadoop.fs.s3nativeでのFileSystemのサブクラス

修飾子とタイプ	クラスと説明
class	NativeS3FileSystem A FileSystem for reading and writing files stored on Amazon S3.

org.apache.hadoop.fs.viewfsでのFileSystemの使用

org.apache.hadoop.fs.viewfsでのFileSystemのサブクラス

修飾子とタイプ	クラスと説明
class	ViewFileSystem ViewFileSystem (extends the FileSystem interface) implements a client-side mount table.

FileSystemを返すorg.apache.hadoop.fs.viewfsのメソッド

修飾子とタイプ	メソッドと説明
FileSystem[]	ViewFileSystem.getChildFileSystems()

org.apache.hadoop.ioでのFileSystemの使用

FileSystem型のパラメータを持つorg.apache.hadoop.ioのメソッド

修飾子とタイプ	メソッドと説明
static org.apache.hadoop.io.SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass) 非推奨です。 Use SequenceFile.createWriter(Configuration, Writer.Option...) instead.
static org.apache.hadoop.io.SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, int bufferSize, short replication, long blockSize, boolean createParent, org.apache.hadoop.io.SequenceFile.CompressionType compressionType, CompressionCodec codec, org.apache.hadoop.io.SequenceFile.Metadata metadata) 非推奨です。
static org.apache.hadoop.io.SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, int bufferSize, short replication, long blockSize, org.apache.hadoop.io.SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress, org.apache.hadoop.io.SequenceFile.Metadata metadata) 非推奨です。 Use SequenceFile.createWriter(Configuration, Writer.Option...) instead.
static org.apache.hadoop.io.SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, org.apache.hadoop.io.SequenceFile.CompressionType compressionType) 非推奨です。 Use SequenceFile.createWriter(Configuration, Writer.Option...) instead.
static org.apache.hadoop.io.SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, org.apache.hadoop.io.SequenceFile.CompressionType compressionType, CompressionCodec codec) 非推奨です。 Use SequenceFile.createWriter(Configuration, Writer.Option...) instead.
static org.apache.hadoop.io.SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, org.apache.hadoop.io.SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress) 非推奨です。 Use SequenceFile.createWriter(Configuration, Writer.Option...) instead.
static org.apache.hadoop.io.SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, org.apache.hadoop.io.SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress, org.apache.hadoop.io.SequenceFile.Metadata metadata) 非推奨です。 Use SequenceFile.createWriter(Configuration, Writer.Option...) instead.
static org.apache.hadoop.io.SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, org.apache.hadoop.io.SequenceFile.CompressionType compressionType, Progressable progress) 非推奨です。 Use SequenceFile.createWriter(Configuration, Writer.Option...) instead.
static void	BloomMapFile.delete(FileSystem fs, String name)
static void	MapFile.delete(FileSystem fs, String name) Deletes the named map file.
static long	MapFile.fix(FileSystem fs, Path dir, Class<? extends Writable> keyClass, Class<? extends Writable> valueClass, boolean dryrun, Configuration conf) This method attempts to fix a corrupt MapFile by re-creating its index.
static void	MapFile.rename(FileSystem fs, String oldName, String newName) Renames an existing map directory.

org.apache.hadoop.mapredでのFileSystemの使用

FileSystemを返すorg.apache.hadoop.mapredのメソッド

修飾子とタイプ	メソッドと説明
FileSystem	JobClient.getFs() Get a filesystem handle.

FileSystem型のパラメータを持つorg.apache.hadoop.mapredのメソッド

修飾子とタイプ	メソッドと説明
protected void	FileInputFormat.addInputPathRecursively(List<FileStatus> result, FileSystem fs, Path path, PathFilter inputFilter) Add files in the input path recursively into the results.
void	SequenceFileAsBinaryOutputFormat.checkOutputSpecs(FileSystem ignored, JobConf job)
void	FileOutputFormat.checkOutputSpecs(FileSystem ignored, JobConf job)
void	OutputFormat.checkOutputSpecs(FileSystem ignored, JobConf job) Check for validity of the output-specification for the job.
static org.apache.hadoop.io.MapFile.Reader[]	MapFileOutputFormat.getReaders(FileSystem ignored, Path dir, Configuration conf) Open the output generated by this format.
RecordWriter<WritableComparable,Writable>	MapFileOutputFormat.getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress)
RecordWriter<K,V>	SequenceFileOutputFormat.getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress)
RecordWriter<BytesWritable,BytesWritable>	SequenceFileAsBinaryOutputFormat.getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress)
RecordWriter<K,V>	TextOutputFormat.getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress)
abstract RecordWriter<K,V>	FileOutputFormat.getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress)
RecordWriter<K,V>	OutputFormat.getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress) Get the RecordWriter for the given job.
static boolean	JobClient.isJobDirValid(Path jobDirPath, FileSystem fs) Checks if the job directory is clean and has all the required components for (re) starting the job
protected boolean	KeyValueTextInputFormat.isSplitable(FileSystem fs, Path file)
protected boolean	TextInputFormat.isSplitable(FileSystem fs, Path file)
protected boolean	FileInputFormat.isSplitable(FileSystem fs, Path filename) Is the given filename splittable?
protected boolean	FixedLengthInputFormat.isSplitable(FileSystem fs, Path file)

org.apache.hadoop.mapred.libでのFileSystemの使用

FileSystem型のパラメータを持つorg.apache.hadoop.mapred.libのメソッド

修飾子とタイプ	メソッドと説明
void	NullOutputFormat.checkOutputSpecs(FileSystem ignored, JobConf job)
void	LazyOutputFormat.checkOutputSpecs(FileSystem ignored, JobConf job)
void	FilterOutputFormat.checkOutputSpecs(FileSystem ignored, JobConf job)
protected RecordWriter<K,V>	MultipleSequenceFileOutputFormat.getBaseRecordWriter(FileSystem fs, JobConf job, String name, Progressable arg3)
protected abstract RecordWriter<K,V>	MultipleOutputFormat.getBaseRecordWriter(FileSystem fs, JobConf job, String name, Progressable arg3)
protected RecordWriter<K,V>	MultipleTextOutputFormat.getBaseRecordWriter(FileSystem fs, JobConf job, String name, Progressable arg3)
RecordWriter<K,V>	NullOutputFormat.getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress)
RecordWriter<K,V>	LazyOutputFormat.getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress)
RecordWriter<K,V>	FilterOutputFormat.getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress)
RecordWriter<K,V>	MultipleOutputFormat.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable arg3) Create a composite record writer that can write key/value data to different output files
protected boolean	CombineFileInputFormat.isSplitable(FileSystem fs, Path file)

org.apache.hadoop.mapred.lib.dbでのFileSystemの使用

FileSystem型のパラメータを持つorg.apache.hadoop.mapred.lib.dbのメソッド

修飾子とタイプ	メソッドと説明
void	DBOutputFormat.checkOutputSpecs(FileSystem filesystem, JobConf job) Check for validity of the output-specification for the job.
RecordWriter<K,V>	DBOutputFormat.getRecordWriter(FileSystem filesystem, JobConf job, String name, Progressable progress) Get the RecordWriter for the given job.

org.apache.hadoop.mapreduceでのFileSystemの使用

FileSystemを返すorg.apache.hadoop.mapreduceのメソッド

修飾子とタイプ	メソッドと説明
FileSystem	Cluster.getFileSystem() Get the file system where job-specific files are stored

org.apache.hadoop.mapreduce.lib.inputでのFileSystemの使用

FileSystem型のパラメータを持つorg.apache.hadoop.mapreduce.lib.inputのメソッド

修飾子とタイプ	メソッドと説明
protected void	FileInputFormat.addInputPathRecursively(List<FileStatus> result, FileSystem fs, Path path, PathFilter inputFilter) Add files in the input path recursively into the results.
protected BlockLocation[]	CombineFileInputFormat.getFileBlockLocations(FileSystem fs, FileStatus stat)

org.apache.hadoop.metrics2.sinkでのFileSystemの使用

FileSystemとして宣言されているorg.apache.hadoop.metrics2.sinkのフィールド

修飾子とタイプ	フィールドと説明
protected static FileSystem	RollingFileSystemSink.suppliedFilesystem