All Classes and Interfaces (Apache Hadoop Main 3.5.0 API)
Description: class index

# All Classes and Interfaces

Class
Description
AbfsBackoffMetricsEnum
Enum representing various ABFS backoff metrics
AbfsBlockStatus
Enum representing the status of an ABFS block.
AbfsDriverException
Exception to be thrown if any Runtime Exception occurs.
AbfsErrors
ABFS error constants.
AbfsHttpConstants
Responsible to keep all constant keys used in abfs rest client here.
AbfsHttpConstants.ApiVersion
Specifies the version of the REST protocol used for processing the request.
AbfsInvalidChecksumException
Exception to wrap invalid checksum verification on client side.
AbfsReadFooterMetricsEnum
Enum representing various ABFS read footer metrics.
AbfsReadPolicy
Enum for ABFS Input Policies.
AbfsReadResourceUtilizationMetricsEnum
Enum representing the set of metrics tracked for the ABFS read thread pool.
AbfsRestOperationException
Exception to wrap Azure service error responses.
AbfsRestOperationType
The REST operation type (Read, Append, Other ).
AbfsServiceType
Azure Storage Offers two sets of Rest APIs for interacting with the storage account.
AbfsStatistic
Statistic which are collected in Abfs.
Abortable
Abort data being written to a stream, so that close() does not write the data.
AbstractCounters<C extends Counter,G extends CounterGroupBase<C>>
An abstract class to provide common implementation for the Counters container in both mapred and mapreduce packages.
AbstractDelegationTokenIdentifier
AbstractDelegationTokenSecretManager<TokenIdent extends AbstractDelegationTokenIdentifier>
AbstractDNSToSwitchMapping
This is a base class for DNS to Switch mappings.
AbstractEvent<TYPE extends Enum<TYPE>>
Parent class of all the events.
AbstractFileSystem
This class provides an interface for implementors of a Hadoop file system (analogous to the VFS of Unix).
AbstractFSBuilderImpl<S,B extends FSBuilder<S,B>>
Builder for filesystem/filecontext operations of various kinds, with option support.
AbstractGangliaSink.GangliaConfType
define enum for various type of conf
AbstractGangliaSink.GangliaSlope
ganglia slope values which equal the ordinal
AbstractLaunchableService
Subclass of `AbstractService` that provides basic implementations of the `LaunchableService` methods.
AbstractLivelinessMonitor<O>
A simple liveliness monitor with which clients can register, trust the component to monitor liveliness, get a call-back on expiry and then finally unregister.
AbstractMapWritable
Abstract base class for MapWritable and SortedMapWritable Unlike org.apache.nutch.crawl.MapWritable, this class allows creation of MapWritable<Writable, MapWritable> so the CLASS_TO_ID and ID_TO_CLASS maps travel with the class instead of being static.
AbstractMetric
The immutable metric
AbstractS3ACommitter.JobUUIDSource
Enumeration of Job UUID source.
AbstractService
This is the base implementation class for services.
AccessControlException
An exception class for access control related issues.
AccessControlList
Class representing a configured access control list.
AccessPrivilege
AccessRequest
This request object contains all the context information to determine whether a user has permission to access the target entity.
AccessTokenProvider
Provide an OAuth2 access token to be used to authenticate http calls in WebHDFS.
AccessTokenTimer
Access tokens generally expire.
AclEntry
Defines a single entry in an ACL.
AclEntryScope
Specifies the scope or intended usage of an ACL entry.
AclEntryStatusFormat
Class to pack an AclEntry into an integer.
AclEntryType
Specifies the type of an ACL entry.
AclProtos.AclEntryProto.AclEntryScopeProto
Protobuf enum `hadoop.hdfs.AclEntryProto.AclEntryScopeProto`
AclProtos.AclEntryProto.AclEntryTypeProto
Protobuf enum `hadoop.hdfs.AclEntryProto.AclEntryTypeProto`
AclProtos.AclEntryProto.FsActionProto
Protobuf enum `hadoop.hdfs.AclEntryProto.FsActionProto`
AclStatus
An AclStatus contains the ACL information of a specific file.
AddingCompositeService
Composite service that exports the add/remove methods.
AddressTypes
Enum of address types -as integers.
Adl
Expose adl:// scheme to access ADL file system.
AdlConfKeys
Constants.
AdlFileSystem
A FileSystem to access Azure Data Lake Store.
AdminSecurityInfo
AggregatedLogFormat
AggregatedLogFormat.LogKey
AggregatedLogFormat.LogReader
AHSClient
AHSProxy<T>
AllocateRequest
The core request sent by the `ApplicationMaster` to the `ResourceManager` to obtain resources in the cluster.
AllocateRequest.AllocateRequestBuilder
Class to construct instances of `AllocateRequest` with specific options.
AllocateResponse
The response sent by the `ResourceManager` the `ApplicationMaster` during resource negotiation.
AllocationTagNamespaceType
Class to describe all supported forms of namespaces for an allocation tag.
AMCommand
Command sent by the Resource Manager to the Application Master in the AllocateResponse
AMRMClient<T extends org.apache.hadoop.yarn.client.api.AMRMClient.ContainerRequest>
AMRMClientAsync<T extends org.apache.hadoop.yarn.client.api.AMRMClient.ContainerRequest>
`AMRMClientAsync` handles communication with the ResourceManager and provides asynchronous updates on events such as container allocations and completions.
AMRMTokenIdentifier
AMRMTokenIdentifier is the TokenIdentifier to be used by ApplicationMasters to authenticate to the ResourceManager.
AMRMTokenSelector
AppAdminClient
Client for managing applications.
AppendRequestParameters.Mode
ApplicationAccessType
Application access types.
ApplicationAttemptEntity
This entity represents an application attempt.
ApplicationAttemptId
`ApplicationAttemptId` denotes the particular attempt of an `ApplicationMaster` for a given `ApplicationId`.
ApplicationAttemptNotFoundException
This exception is thrown on `(GetApplicationAttemptReportRequest)` API when the Application Attempt doesn't exist in Application History Server or `ApplicationMasterProtocol.allocate(AllocateRequest)` if application doesn't exist in RM.
ApplicationAttemptReport
`ApplicationAttemptReport` is a report of an application attempt.
ApplicationClassLoader
A `URLClassLoader` for application isolation.
ApplicationClassLoader
Deprecated.
ApplicationClientProtocol
The protocol between clients and the `ResourceManager` to submit/abort jobs and to get information on applications, cluster metrics, nodes, queues and ACLs.
ApplicationConstants
This is the API for the applications comprising of constants that YARN sets up for the applications and the containers.
ApplicationConstants.ContainerLaunchType
The type of launch for the container.
ApplicationConstants.Environment
Environment for Applications.
ApplicationEntity
This entity represents an application.
ApplicationHistoryProtocol
The protocol between clients and the `ApplicationHistoryServer` to get the information of completed applications etc.
ApplicationId
`ApplicationId` represents the globally unique identifier for an application.
ApplicationIdNotProvidedException
Exception to be thrown when Client submit an application without providing `ApplicationId` in `ApplicationSubmissionContext`.
ApplicationMaster
The ApplicationMaster for Dynamometer.
ApplicationMaster
An ApplicationMaster for executing shell commands on a set of launched containers using the YARN framework.
ApplicationMasterProtocol
The protocol between a live instance of `ApplicationMaster` and the `ResourceManager`.
ApplicationNotFoundException
This exception is thrown on `(GetApplicationReportRequest)` API when the Application doesn't exist in RM and AHS
ApplicationReport
`ApplicationReport` is a report of an application.
ApplicationResourceUsageReport
Contains various scheduling metrics to be reported by UI and CLI.
ApplicationsRequestScope
Enumeration that controls the scope of applications fetched
ApplicationSubmissionContext
`ApplicationSubmissionContext` represents all of the information needed by the `ResourceManager` to launch the `ApplicationMaster` for an application.
ApplicationTimeout
`ApplicationTimeout` is a report for configured application timeouts.
ApplicationTimeoutType
Application timeout type.
ArrayFile
A dense file-based mapping from integers to values.
ArrayListBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
ArrayListBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
ArrayPrimitiveWritable
This is a wrapper class.
ArrayWritable
A Writable for arrays containing instances of a class.
Artifact
Artifact of an service component.
Artifact.TypeEnum
Artifact Type.
AssumedRoleCredentialProvider
Support IAM Assumed roles by instantiating an instance of `STSAssumeRoleSessionCredentialsProvider` from configuration properties, including wiring up the inner authenticator, and, unless overridden, creating a session name from the current user.
AsyncDispatcher
Dispatches `Event`s in a separate thread.
AttributeExpressionOperation
Operations which are allowed in Node Attributes Expression.
AuditLogger
Interface defining an audit logger.
AuditorFlags
Flags which can be passed down during initialization, or after it.
AuditReplayMapper.CommandType
Define the type of command, either read or write.
AuditReplayMapper.ReplayCommand
Definitions of the various commands that can be replayed.
AuditReplayMapper.REPLAYCOUNTERS
`Counter` definitions for replay.
AuthConfigurations
Responsible to keep all the Azure Blob File System auth related configurations.
AuthorizationException
An exception class for authorization-related issues.
AuthType
Auth Type Enum.
Avataar
AvroFSInput
Adapts an `FSDataInputStream` to Avro's SeekableInput interface.
AvroReflectSerializable
Tag interface for Avro 'reflect' serializable classes.
AvroReflectSerialization
Serialization for Avro Reflect classes.
AvroSerialization<T>
Base class for providing serialization to Avro types.
AvroSpecificSerialization
Serialization for Avro Specific classes.
AWSCannedACL
Enum to map AWS SDK V1 Acl values to SDK V2.
AWSPolicyProvider.AccessLevel
Access levels.
AWSS3IOException
Wrap a `S3Exception` as an IOE, relaying all getters.
AWSServiceIOException
A specific exception from AWS operations.
AzureADTokenProvider
Provide an Azure Active Directory supported OAuth2 access token to be used to authenticate REST calls against Azure data lake file system `AdlFileSystem`.
AzureBlobFileSystemException
Base exception for any Azure Blob File System driver exceptions.
AzureBlobFileSystemStore
Provides the bridging logic between Hadoop's abstract filesystem and Azure Storage.
AzureManifestCommitterFactory
A Committer for the manifest committer which performs all bindings needed to work best with abfs.
AzureServiceErrorCode
Azure service error codes.
BadFencingConfigurationException
Indicates that the operator has specified an invalid configuration for fencing methods.
Base64StringConfigurationBasicValidator
String Base64 configuration value Validator.
BaseClientToAMTokenSecretManager
A base `SecretManager` for AMs to extend and validate Client-RM tokens issued to clients by the RM using the underlying master-key shared by RM to the AMs on their launch.
BaseResource
BatchListingOperations
Interface filesystems MAY implement to offer a batched list.
Bellard.Parameter
Parameters for the sums
BigDecimalSplitter
Implement DBSplitter over BigDecimal values.
BinaryComparable
Interface supported by `WritableComparable` types supporting ordering/permutation by a representative set of bytes.
BinaryPartitioner<V>
Partition `BinaryComparable` keys using a configurable part of the bytes array returned by `BinaryComparable.getBytes()`.
BinaryPartitioner<V>
Partition `BinaryComparable` keys using a configurable part of the bytes array returned by `BinaryComparable.getBytes()`.
BinaryRecordInput
Deprecated.
Replaced by Avro.
BinaryRecordOutput
Deprecated.
Replaced by Avro.
BindFlags
Combinable Flags to use when creating a service entry.
BindingInformation
Binding information provided by a `RegistryBindingSource`
BindingPathOutputCommitter
This is a special committer which creates the factory for the committer and runs off that.
BlobCopyProgress
Enum for BlobCopyProgress.
BlockAlias
Interface used to load provided blocks.
BlockAliasMap<T extends BlockAlias>
An abstract class used to read and write block maps for provided blocks.
BlockCompressorStream
A `CompressorStream` which works with 'block-based' based compression algorithms, as opposed to 'stream-based' compression algorithms.
BlockDecompressorStream
A `DecompressorStream` which works with 'block-based' based compression algorithms, as opposed to 'stream-based' compression algorithms.
BlockLocation
Represents the network location of a block, information about the hosts that contain block replicas, and other block metadata (E.g. the file offset associated with the block, length, whether it is corrupt, etc).
BlockOperations.Kind
Operation kind.
BlockPlacementPolicyDefault.NodeNotChosenReason
BlockReportOptions
Options that can be specified when manually triggering a block report.
BlockResolver
Given an external reference, create a sequence of blocks and associated metadata.
BlockStoragePolicySpi
A storage policy specifies the placement of block replicas on specific storage types.
BlockTokenIdentifier.AccessMode
BlockType
Type of a block.
BloomFilter
Implements a Bloom filter, as defined by Bloom in 1970.
BloomMapFile
This class extends `MapFile` and provides very much the same functionality.
BooleanConfigurationBasicValidator
Boolean configuration value validator.
BooleanSplitter
Implement DBSplitter over boolean values.
BooleanWritable
A WritableComparable for booleans.
BoundedAppender
A `CharSequence` appender that considers its `BoundedAppender.limit` as upper bound.
Buffer
Deprecated.
Replaced by Avro.
BufferData.State
BuiltInGzipDecompressor.GzipStateLabel
The current state of the gzip decoder, external to the Inflater context.
BulkDelete
API for bulk deletion of objects/files, but not directories.
BulkDeleteSource
Interface for bulk deletion.
ByteBufferPool
ByteBufferPositionedReadable
Implementers of this interface provide a positioned read API that writes to a `ByteBuffer` rather than a `byte[]`.
ByteBufferReadable
Implementers of this interface provide a read API that writes to a ByteBuffer, not a byte[].
BytesWritable
A byte sequence that is usable as a key or value.
ByteWritable
A WritableComparable for a single byte.
BZip2Codec
This class provides output and input streams for bzip2 compression and decompression.
CachedDNSToSwitchMapping
A cached implementation of DNSToSwitchMapping that takes an raw DNSToSwitchMapping and stores the resolved network location in a cache.
CacheDirectiveEntry
Describes a path-based cache directive entry.
CacheDirectiveInfo
Describes a path-based cache directive.
CacheDirectiveStats
Describes a path-based cache directive.
CacheFlag
Specifies semantics for CacheDirective operations.
CachePoolEntry
Describes a Cache Pool entry.
CachePoolInfo
CachePoolInfo describes a cache pool.
CachePoolStats
CachePoolStats describes cache pool statistics.
CallerContext
A class defining the caller context for auditing coarse granularity operations.
CancelDelegationTokenRequest
The request issued by the client to the `ResourceManager` to cancel a delegation token.
CancelDelegationTokenResponse
The response from the `ResourceManager` to a cancelDelegationToken request.
CannotObtainBlockLengthException
This exception is thrown when the length of a LocatedBlock instance can not be obtained.
CanSetDropBehind
CanSetReadahead
CanUnbuffer
FSDataInputStreams implement this interface to indicate that they can clear their buffers on request.
CBZip2InputStream.STATE
A state machine to keep track of current state of the de-coder
ChainMapper
The ChainMapper class allows to use multiple Mapper classes within a single Map task.
ChainMapper<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
The ChainMapper class allows to use multiple Mapper classes within a single Map task.
ChainReducer
The ChainReducer class allows to chain multiple Mapper classes after a Reducer within the Reducer task.
ChainReducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
The ChainReducer class allows to chain multiple Mapper classes after a Reducer within the Reducer task.
ChangeDetectionPolicy.Mode
What to do when change is detected.
ChangeDetectionPolicy.Source
The S3 object attribute used to detect change.
Checkpointable
Contract representing to the framework that the task can be safely preempted and restarted between invocations of the user-defined function.
ChecksumException
Thrown for checksum errors.
ChecksumFileSystem
Abstract Checksumed FileSystem.
ChecksumType
CleanupJobStage.Outcome
Enum of outcomes.
CLI
Interprets the map reduce cli options
Client
A client for an IPC service.
Client
Client for submitting a Dynamometer YARN application, and optionally, a workload MapReduce job.
Client
Client for Distributed Shell application submission to YARN.
ClientAssertionProvider
Interface for providing client assertions for Azure Workload Identity authentication.
ClientNamenodeProtocolProtos.AddBlockFlagProto
Protobuf enum `hadoop.hdfs.AddBlockFlagProto`
ClientNamenodeProtocolProtos.CacheFlagProto
Protobuf enum `hadoop.hdfs.CacheFlagProto`
ClientNamenodeProtocolProtos.CreateFlagProto
Protobuf enum `hadoop.hdfs.CreateFlagProto`
ClientNamenodeProtocolProtos.DatanodeReportTypeProto
type of the datanode report
ClientNamenodeProtocolProtos.OpenFilesTypeProto
Protobuf enum `hadoop.hdfs.OpenFilesTypeProto`
ClientNamenodeProtocolProtos.RollingUpgradeActionProto
Protobuf enum `hadoop.hdfs.RollingUpgradeActionProto`
ClientNamenodeProtocolProtos.SafeModeActionProto
Protobuf enum `hadoop.hdfs.SafeModeActionProto`
ClientRMProxy<T>
ClientRMSecurityInfo
ClientSCMProtocol
The protocol between clients and the `SharedCacheManager` to claim and release resources in the shared cache.
ClientTimelineSecurityInfo
ClientToAMTokenIdentifier
ClientToAMTokenSecretManager
A simple `SecretManager` for AMs to validate Client-RM tokens issued to clients by the RM using the underlying master-key shared by RM to the AMs on their launch.
Clock
A simple clock interface that gives you time.
Closeable
Deprecated.
use java.io.Closeable
CloseableTaskPoolSubmitter
A task submitter which is closeable, and whose close() call shuts down the pool.
ClosedIOException
Exception to denote if the underlying stream, cache or other closable resource is closed.
Cluster
Provides a way to access information about the map/reduce cluster.
Cluster.JobTrackerStatus
ClusterEntity
This entity represents a YARN cluster.
ClusterMetrics
Status information on the current state of the Map-Reduce cluster.
ClusterStatus
Status information on the current state of the Map-Reduce cluster.
ClusterStorageCapacityExceededException
Exception raised by HDFS indicating that storage capacity in the cluster filesystem is exceeded.
CodecConstants
Codec related constants.
CodecPool
A global compressor/decompressor pool used to save and reuse (possibly native) compression/decompression codecs.
CollectorInfo
Collector info containing collector address and collector token passed from RM to AM in Allocate Response.
CombineFileInputFormat<K,V>
An abstract `InputFormat` that returns `CombineFileSplit`'s in `InputFormat.getSplits(JobConf, int)` method.
CombineFileInputFormat<K,V>
An abstract `InputFormat` that returns `CombineFileSplit`'s in `InputFormat.getSplits(JobContext)` method.
CombineFileRecordReader<K,V>
A generic RecordReader that can hand out different recordReaders for each chunk in a `CombineFileSplit`.
CombineFileRecordReader<K,V>
A generic RecordReader that can hand out different recordReaders for each chunk in a `CombineFileSplit`.
CombineFileRecordReaderWrapper<K,V>
A wrapper class for a record reader that handles a single file split.
CombineFileRecordReaderWrapper<K,V>
A wrapper class for a record reader that handles a single file split.
CombineFileSplit
CombineFileSplit
A sub-collection of input files.
CombineSequenceFileInputFormat<K,V>
Input format that is a `CombineFileInputFormat`-equivalent for `SequenceFileInputFormat`.
CombineSequenceFileInputFormat<K,V>
Input format that is a `CombineFileInputFormat`-equivalent for `SequenceFileInputFormat`.
CombineTextInputFormat
Input format that is a `CombineFileInputFormat`-equivalent for `TextInputFormat`.
CombineTextInputFormat
Input format that is a `CombineFileInputFormat`-equivalent for `TextInputFormat`.
CommitConstants
Constants for working with committers.
CommitResponse
Response to Commit Container Request.
CommitterEventType
CommitterStatisticNames
Statistic names for committers.
CommonAuditContext
The common audit context is a map of common context information which can be used with any audit span.
CommonConfigurationKeysPublic
This class contains constants for configuration keys used in the common code.
Component
One or more components of the service.
Component.RestartPolicyEnum
Policy of restart component.
ComponentContainers
Containers of a component.
ComponentEventType
ComponentInstanceEventType
ComponentInstanceState
ComponentState
ComponentState
ComposableInputFormat<K extends WritableComparable,V extends Writable>
Refinement of InputFormat requiring implementors to provide ComposableRecordReader instead of RecordReader.
ComposableInputFormat<K extends WritableComparable<?>,V extends Writable>
Refinement of InputFormat requiring implementors to provide ComposableRecordReader instead of RecordReader.
ComposableRecordReader<K extends WritableComparable,V extends Writable>
Additional operations required of a RecordReader to participate in a join.
ComposableRecordReader<K extends WritableComparable<?>,V extends Writable>
Additional operations required of a RecordReader to participate in a join.
CompositeInputFormat<K extends WritableComparable>
An InputFormat capable of performing joins over a set of data sources sorted and partitioned the same way.
CompositeInputFormat<K extends WritableComparable>
An InputFormat capable of performing joins over a set of data sources sorted and partitioned the same way.
CompositeInputSplit
This InputSplit contains a set of child InputSplits.
CompositeInputSplit
This InputSplit contains a set of child InputSplits.
CompositeRecordReader<K extends WritableComparable,V extends Writable,X extends Writable>
A RecordReader that can effect joins of RecordReaders sharing a common key type and partitioning.
CompositeRecordReader<K extends WritableComparable<?>,V extends Writable,X extends Writable>
A RecordReader that can effect joins of RecordReaders sharing a common key type and partitioning.
CompositeService
Composition of services.
CompressedWritable
A base-class for Writables which store themselves compressed and lazily inflate on field access.
Compression.Algorithm
Compression algorithms.
CompressionCodec
This class encapsulates a streaming compression/decompression pair.
CompressionCodecFactory
A factory that will find the correct codec for a given filename.
CompressionInputStream
A compression input stream.
CompressionOutputStream
A compression output stream.
Compressor
Specification of a stream-based 'compressor' which can be plugged into a `CompressionOutputStream` to compress data.
CompressorStream
ConcurrentWriteOperationDetectedException
Thrown when a concurrent write operation is detected.
ConfCredentialBasedAccessTokenProvider
Obtain an access token via a a credential (provided through the Configuration) using the Client Credentials Grant workflow.
ConfigFile
A config file that needs to be created and made available as a volume in an service component container.
ConfigFile.TypeEnum
Config Type.
ConfigFormat
Configurable
Something that may be configured with a `Configuration`.
Configuration
Provides access to configuration parameters.
Configuration
Set of configuration properties that can be injected into the service components via envs, files and custom pluggable helper docker containers.
ConfigurationException
This exception is thrown on unrecoverable configuration errors.
ConfigurationKeys
Responsible to keep all the Azure Blob File System configurations keys in Hadoop configuration file.
ConfigurationPropertyNotFoundException
Thrown when a searched for element is not found
Configured
Base class for things that may be configured with a `Configuration`.
ConflictResolution
Enum of conflict resolution algorithms.
ConfRefreshTokenBasedAccessTokenProvider
Supply a access token obtained via a refresh token (provided through the Configuration using the second half of the Authorization Code Grant workflow.
ConnectTimeoutException
Thrown by `NetUtils.connect(java.net.Socket, java.net.SocketAddress, int)` if it times out while connecting to the remote host.
Constants
Constants used with the `S3AFileSystem`.
Container
`Container` represents an allocated resource in the cluster.
Container
An instance of a running service container.
ContainerAllocator.EventType
ContainerEntity
This entity represents a container belonging to an application attempt.
ContainerExitStatus
Container exit statuses indicating special exit circumstances.
ContainerId
`ContainerId` represents a globally unique identifier for a `Container` in the cluster.
ContainerLaunchContext
`ContainerLaunchContext` represents all of the information needed by the `NodeManager` to launch a container.
ContainerLauncher.EventType
ContainerLogAggregationType
Enumeration of various aggregation type of a container log.
ContainerLogAppender
A simple log4j-appender for container's logs.
ContainerManagementProtocol
The protocol between an `ApplicationMaster` and a `NodeManager` to start/stop and increase resource of containers and to get status of running containers.
ContainerManagerSecurityInfo
ContainerNotFoundException
This exception is thrown on `(GetContainerReportRequest)` API when the container doesn't exist in AHS
ContainerReport
`ContainerReport` is a report of an container.
ContainerRetryContext
`ContainerRetryContext` indicates how container retry after it fails to run.
ContainerRetryPolicy
Retry policy for relaunching a `Container`.
ContainerRollingLogAppender
A simple log4j-appender for container's logs.
ContainerState
State of a `Container`.
ContainerState
The current state of the container of an application.
ContainerStatus
`ContainerStatus` represents the current status of a `Container`.
ContainerSubState
Container Sub-State.
ContainerTokenIdentifier
TokenIdentifier for a container.
ContainerTokenSelector
ContainerUpdateRequest
The request sent by `Application Master` to the `Node Manager` to change the resource quota of a container.
ContainerUpdateResponse
The response sent by the `NodeManager` to the `ApplicationMaster` when asked to update container resource.
ContainerUpdateType
Encodes the type of Container Update.
Content
The content types such as file, directory and symlink to be computed.
ContentSummary
Store the summary of a content (a directory or a file).
ControlledJob
This class encapsulates a MapReduce job and its dependency.
ControlledJob.State
ConverterUtils
This class contains a set of utilities which help converting data structures from/to 'serializableFormat' to/from hadoop/nativejava data structures.
CopyMapper.ChecksumComparison
Indicates the checksum comparison result.
CopyMapper.Counter
Hadoop counters for the DistCp CopyMapper.
CorruptReplicasMap.Reason
The corruption reason code
Counter
A named counter that tracks the progress of a map/reduce job.
CounterGroup
A group of `Counter`s that logically belong together.
CounterGroupBase<T extends Counter>
The common counter group interface.
Counters
A set of named counters.
Counters
`Counters` holds per job/task counters, defined either by the Map-Reduce framework or applications.
Counters.Counter
A counter record, comprising its name and value.
Counters.Group
`Group` of counters, comprising of counters from a particular counter `Enum` class.
CountingBloomFilter
Implements a counting Bloom filter, as defined by Fan et al. in a ToN 2000 paper.
CreateEncryptionZoneFlag
CreateEncryptionZoneFlag is used in `HdfsAdmin.createEncryptionZone(Path, String, EnumSet)` to indicate what should be done when creating an encryption zone.
CreateFileMapper.CREATEFILECOUNTERS
Custom `Counter` definitions.
CreateFlag
CreateFlag specifies the file create semantic.
CreateOutputDirectoriesStage.DirMapState
Enumeration of dir states in the dir map.
CredentialBasedAccessTokenProvider
Obtain an access token via the credential-based OAuth2 workflow.
CredentialInitializationException
Exception which Hadoop's AWSCredentialsProvider implementations should throw when there is a problem with the credential setup.
CredentialProvider
A provider of credentials or password for Hadoop applications.
CredentialProviderFactory
A factory to create a list of CredentialProvider based on the path given in a Configuration.
Credentials
A class that provides the facilities of reading and writing secret keys and Tokens.
Credentials.SerializedFormat
CSEMaterials.CSEKeyType
Enum for CSE key types.
Csi.ControllerServiceCapability.RPC.Type
Protobuf enum `csi.v0.ControllerServiceCapability.RPC.Type`
Csi.ControllerServiceCapability.TypeCase
Csi.NodeServiceCapability.RPC.Type
Protobuf enum `csi.v0.NodeServiceCapability.RPC.Type`
Csi.NodeServiceCapability.TypeCase
Csi.PluginCapability.Service.Type
Protobuf enum `csi.v0.PluginCapability.Service.Type`
Csi.PluginCapability.TypeCase
Csi.SnapshotStatus.Type
Protobuf enum `csi.v0.SnapshotStatus.Type`
Csi.VolumeCapability.AccessMode.Mode
Protobuf enum `csi.v0.VolumeCapability.AccessMode.Mode`
Csi.VolumeCapability.AccessTypeCase
Csi.VolumeContentSource.TypeCase
CsvRecordOutput
Deprecated.
Replaced by Avro.
DataBlocks.DataBlock.DestState
DataChecksum.Type
The checksum types
DataDrivenDBInputFormat<T extends DBWritable>
A InputFormat that reads input data from an SQL table.
DataDrivenDBRecordReader<T extends DBWritable>
A RecordReader that reads records from a SQL table, using data-driven WHERE clause splits.
DatanodeDescriptor.CachedBlocksList.Type
DatanodeInfo.AdminStates
DataNodeLayoutVersion.Feature
Enums for features that change the layout version.
DataNodeLockManager.LockLevel
Acquire block pool level and volume level lock first if you want to acquire dir lock.
DatanodeProtocolProtos.BlockCommandProto.Action
Protobuf enum `hadoop.hdfs.datanode.BlockCommandProto.Action`
DatanodeProtocolProtos.BlockIdCommandProto.Action
Protobuf enum `hadoop.hdfs.datanode.BlockIdCommandProto.Action`
DatanodeProtocolProtos.DatanodeCommandProto.Type
Protobuf enum `hadoop.hdfs.datanode.DatanodeCommandProto.Type`
DatanodeProtocolProtos.ErrorReportRequestProto.ErrorCode
Protobuf enum `hadoop.hdfs.datanode.ErrorReportRequestProto.ErrorCode`
DatanodeProtocolProtos.ReceivedDeletedBlockInfoProto.BlockStatus
Protobuf enum `hadoop.hdfs.datanode.ReceivedDeletedBlockInfoProto.BlockStatus`
DatanodeStorage.State
The state of the storage.
DataOutputOutputStream
OutputStream implementation that wraps a DataOutput.
DataTransferProtos.DataTransferEncryptorMessageProto.DataTransferEncryptorStatus
Protobuf enum `hadoop.hdfs.DataTransferEncryptorMessageProto.DataTransferEncryptorStatus`
DataTransferProtos.OpWriteBlockProto.BlockConstructionStage
Protobuf enum `hadoop.hdfs.OpWriteBlockProto.BlockConstructionStage`
DataTransferProtos.ShortCircuitFdResponse
Protobuf enum `hadoop.hdfs.ShortCircuitFdResponse`
DataTransferProtos.Status
Status is a 4-bit enum
DateSplitter
Implement DBSplitter over date/time values.
DBConfiguration
DBConfiguration
A container for configuration property names for jobs with DB input/output.
DBInputFormat<T extends DBWritable>
DBInputFormat<T extends DBWritable>
A InputFormat that reads input data from an SQL table.
DBOutputFormat<K extends DBWritable,V>
DBOutputFormat<K extends DBWritable,V>
A OutputFormat that sends the reduce output to a SQL table.
DBRecordReader<T extends DBWritable>
A RecordReader that reads records from a SQL table.
DBSplitter
DBSplitter will generate DBInputSplits to use with DataDrivenDBInputFormat.
DBWritable
DBWritable
Objects that are read from/written to a database should implement `DBWritable`.
DecommissionType
Specifies the different types of decommissioning of nodes.
Decompressor
Specification of a stream-based 'de-compressor' which can be plugged into a `CompressionInputStream` to compress data.
DecompressorStream
DefaultAuditLogger
This class provides an interface for Namenode and Router to Audit events information.
DefaultCodec
DefaultImpersonationProvider
DefaultMetricsSystem
The default metrics system singleton.
DefaultSerializer
DefaultStringifier<T>
DefaultStringifier is the default implementation of the `Stringifier` interface which stringifies the objects using base64 encoding of the serialized version of the objects.
DelegatingSSLSocketFactory.SSLChannelMode
Default indicates Ordered, preferred OpenSSL, if failed to load then fall back to Default_JSSE.
DelegationConstants
All the constants related to delegation tokens.
DelegationTokenAuthenticatedURL
The `DelegationTokenAuthenticatedURL` is a `AuthenticatedURL` sub-class with built-in Hadoop Delegation Token functionality.
DelegationTokenAuthenticatedURL.Token
Client side authentication token that handles Delegation Tokens.
DelegationTokenAuthenticator
`Authenticator` wrapper that enhances an `Authenticator` with Delegation Token support.
DeleteOpParam.Op
Delete operations.
DestinationOrder
Order of the destinations when we have multiple of them.
DFSInotifyEventInputStream
Stream for reading inotify events.
DFSOpsCountStatistics.OpType
This is for counting distributed file system operations.
DiagnosticKeys
Diagnostic keys in the manifests.
DirectDecompressionCodec
This class encapsulates a codec which can decompress direct bytebuffers.
DirectDecompressor
Specification of a direct ByteBuffer 'de-compressor'.
DirEntry
A directory entry in the task manifest.
DiskBalancerException.Result
Results returned by the RPC layer of DiskBalancer.
DiskBalancerWorkStatus.Result
Various result values.
Dispatcher
Event Dispatcher interface.
DistCp
DistCp is the main driver-class for DistCpV2.
DistCpOptions
The Options class encapsulates all DistCp options.
DistCpOptions.FileAttribute
File attributes for preserve.
DistCpOptionSwitch
Enumeration mapping configuration keys to distcp command line options.
DistCpProcedure.Stage
DistributedCache
Deprecated.
DNSOperations
DNS Operations.
DNSOperationsFactory.DNSImplementation
DNS Implementation type.
DNSToSwitchMapping
An interface that must be implemented to allow pluggable DNS-name/IP-address to RackID resolvers.
DomainSocketFactory.PathState
DoubleValueSum
This class implements a value aggregator that sums up a sequence of double values.
DoubleValueSum
This class implements a value aggregator that sums up a sequence of double values.
DoubleWritable
Writable for Double values.
DSConstants
Constants used in both Client and Application Master
DSQuotaExceededException
DurationInfo
A duration with logging of final state at info or debug in the `close()` call.
DurationStatisticSummary
Summary of duration tracking statistics as extracted from an IOStatistics instance.
DynamicBloomFilter
Implements a dynamic Bloom filter, as defined in the INFOCOM 2006 paper.
ECBlockGroupStats
Get statistics pertaining to blocks of type `BlockType.STRIPED` in the filesystem.
ECSchema
Erasure coding schema to housekeeper relevant information.
ElasticByteBufferPool
This is a simple ByteBufferPool which just creates ByteBuffers as needed.
EncryptionType
Enum EncryptionType to represent the level of encryption applied.
EncryptionZone
A simple class for representing an encryption zone.
EncryptionZonesProtos.ReencryptActionProto
Protobuf enum `hadoop.hdfs.ReencryptActionProto`
EncryptionZonesProtos.ReencryptionStateProto
Protobuf enum `hadoop.hdfs.ReencryptionStateProto`
Endpoint
Description of a single service/component endpoint.
EnumCounter
EnumSetWritable<E extends Enum<E>>
A Writable wrapper for EnumSet.
Errno
Enum representing POSIX errno values.
Error
Event
Events sent by the inotify system.
Event<TYPE extends Enum<TYPE>>
Interface defining events api.
Event.AppendEvent
Sent when an existing file is opened for append.
Event.CloseEvent
Sent when a file is closed after append or create.
Event.CreateEvent
Sent when a new file is created (including overwrite).
Event.CreateEvent.INodeType
Event.EventType
Event.MetadataUpdateEvent
Sent when there is an update to directory or file (none of the metadata tracked here applies to symlinks) that is not associated with another inotify event.
Event.MetadataUpdateEvent.MetadataType
Event.RenameEvent
Sent when a file, directory, or symlink is renamed.
Event.TruncateEvent
Sent when a file is truncated.
Event.UnlinkEvent
Sent when a file, directory, or symlink is deleted.
EventBatch
A batch of events that all happened on the same transaction ID.
EventHandler<T extends Event>
Interface for handling events of type T
EventType
EventWriter.WriteMode
avro encoding format supported by EventWriter.
ExecutionType
Container property encoding execution semantics.
ExecutionTypeRequest
An object of this class represents a specification of the execution guarantee of the Containers associated with a ResourceRequest.
ExitStatus
Exit status - The values associated with each exit status is directly mapped to the process's exit code in command line.
ExponentiallySmoothedTaskRuntimeEstimator.SmoothedValue
FailApplicationAttemptRequest
The request sent by the client to the `ResourceManager` to fail an application attempt.
FailApplicationAttemptResponse
The response sent by the `ResourceManager` to the client failing an application attempt.
FailoverFailedException
Exception thrown to indicate service failover has failed.
FairSchedulerMetrics.Metric
FedBalanceConfigs.TrashOption
FederationNamenodeServiceState
Namenode state in the federation.
FenceMethod
A fencing method is a method by which one node can forcibly prevent another node from making continued progress.
Fetcher.ShuffleErrors
FieldSelectionHelper
This class implements a mapper/reducer class that can be used to perform field selections in a manner similar to unix cut.
FieldSelectionMapper<K,V>
This class implements a mapper class that can be used to perform field selections in a manner similar to unix cut.
FieldSelectionMapReduce<K,V>
This class implements a mapper/reducer class that can be used to perform field selections in a manner similar to unix cut.
FieldSelectionReducer<K,V>
This class implements a reducer class that can be used to perform field selections in a manner similar to unix cut.
FileAlreadyExistsException
Used when target file already exists for any operation and is not configured to be overwritten.
FileAlreadyExistsException
Used when target file already exists for any operation and is not configured to be overwritten.
FileChecksum
An abstract class representing file checksums for files.
FileContext
The FileContext class provides an interface for users of the Hadoop file system.
FileInputFormat<K,V>
A base class for file-based `InputFormat`.
FileInputFormat<K,V>
A base class for file-based `InputFormat`s.
FileInputFormat.Counter
Deprecated.
FileInputFormat.Counter
Deprecated.
FileInputFormatCounter
FileIoProvider.OPERATION
Lists the types of file system operations.
FileOutputCommitter
An `OutputCommitter` that commits files specified in job output directory i.e.
FileOutputCommitter
An `OutputCommitter` that commits files specified in job output directory i.e.
FileOutputFormat<K,V>
A base class for `OutputFormat`.
FileOutputFormat<K,V>
A base class for `OutputFormat`s that read from `FileSystem`s.
FileOutputFormat.Counter
Deprecated.
FileOutputFormat.Counter
Deprecated.
FileOutputFormatCounter
FileRegion
This class is used to represent provided blocks that are file regions, i.e., can be described using (path, offset, length).
FileSink
A metrics sink that writes to a file
FileSplit
A section of an input file.
FileSplit
A section of an input file.
FileStatus
Interface that represents the client side information for a file.
FileStatus.AttrFlags
Flags for entity attributes.
FileSystem
An abstract base class for a fairly generic filesystem.
FileSystemAccessException.ERROR
FileSystemConfigurations
Responsible to keep all the Azure Blob File System related configurations.
FileSystemImage
Create FSImage from an external namespace.
FileSystemOperationUnhandledException
Thrown when an unhandled exception is occurred during a file system operation.
FileSystemStatisticNames
Common statistic names for Filesystem-level statistics, including internals.
FileSystemUriSchemes
Responsible to keep all Azure Blob File System valid URI schemes.
FileType
Enum for file types.
FileUtil
A collection of file-processing util methods
FilterFileSystem
A `FilterFileSystem` contains some other file system, which it uses as its basic file system, possibly transforming the data along the way or providing additional functionality.
FilterOutputFormat<K,V>
FilterOutputFormat is a convenience class that wraps OutputFormat.
FilterOutputFormat<K,V>
FilterOutputFormat is a convenience class that wraps OutputFormat.
FinalApplicationStatus
Enumeration of various final states of an `Application`.
FinishApplicationMasterRequest
The finalization request sent by the `ApplicationMaster` to inform the `ResourceManager` about its completion.
FinishApplicationMasterResponse
The response sent by the `ResourceManager` to a `ApplicationMaster` on it's completion.
FixedBlockMultiReplicaResolver
Resolver mapping all files to a configurable, uniform blocksize and replication.
FixedBlockResolver
Resolver mapping all files to a configurable, uniform blocksize.
FixedLengthInputFormat
FixedLengthInputFormat is an input format used to read input files which contain fixed length records.
FixedLengthInputFormat
FixedLengthInputFormat is an input format used to read input files which contain fixed length records.
FloatSplitter
Implement DBSplitter over floating-point values.
FloatWritable
A WritableComparable for floats.
FlowActivityEntity
Entity that represents a record for flow activity.
FlowRunEntity
This entity represents a flow run.
FsAction
File system actions, e.g. read, write, etc.
FSBuilder<S,B extends FSBuilder<S,B>>
The base interface which various FileSystem FileContext Builder interfaces can extend, and which underlying implementations will then implement.
FsConstants
FileSystem related constants.
FsCreateModes
A class that stores both masked and unmasked create modes and is a drop-in replacement for masked permission.
FSDataInputStream
Utility that wraps a `FSInputStream` in a `DataInputStream` and buffers input through a `BufferedInputStream`.
FSDataOutputStream
Utility that wraps a `OutputStream` in a `DataOutputStream`.
FSDataOutputStreamBuilder<S extends FSDataOutputStream,B extends FSDataOutputStreamBuilder<S,B>>
Builder for `FSDataOutputStream` and its subclasses.
FSDirectory.DirOp
FSError
Thrown for unexpected filesystem errors, presumed to reflect disk errors in the native filesystem.
FSImageFormatProtobuf.SectionName
Supported section name.
FsImageProto.INodeSection.INode.Type
Protobuf enum `hadoop.hdfs.fsimage.INodeSection.INode.Type`
FsImageProto.SnapshotDiffSection.DiffEntry.Type
Protobuf enum `hadoop.hdfs.fsimage.SnapshotDiffSection.DiffEntry.Type`
FSInputStream
FSInputStream is a generic old InputStream with a little bit of RAF-style seek ability.
FSLimitException
FSOperationType
FsPermission
A class for file/directory permissions.
FSProtos.FileStatusProto.FileType
Protobuf enum `hadoop.fs.FileStatusProto.FileType`
FSProtos.FileStatusProto.Flags
Protobuf enum `hadoop.fs.FileStatusProto.Flags`
FsServerDefaults
Provides server default configuration values to clients.
FsStatus
This class is used to represent the capacity, free and used space on a `FileSystem`.
FSStoreOpHandler.StoreType
Store Type enum to hold label and attribute.
FSTreeWalk
Traversal of an external FileSystem.
FsUGIResolver
Dynamically assign ids to users/groups as they appear in the external filesystem.
FsVolumeImpl.BlockDirFilter
Filter for block file names stored on the file system volumes.
FTPException
A class to wrap a `Throwable` into a Runtime Exception.
FTPFileSystem
A `FileSystem` backed by an FTP client provided by Apache Commons Net.
FutureDataInputStreamBuilder
Builder for input streams and subclasses whose return value is actually a completable future: this allows for better asynchronous operation.
FutureDataInputStreamBuilderImpl
Builder for input streams and subclasses whose return value is actually a completable future: this allows for better asynchronous operation.
FutureIO
Future IO Helper methods.
GenericWritable
A wrapper for Writable instances.
GetAllResourceProfilesRequest
Request class for getting all the resource profiles from the RM.
GetAllResourceProfilesResponse
Response class for getting all the resource profiles from the RM.
GetAllResourceTypeInfoRequest
Request class for getting all the resource profiles from the RM.
GetAllResourceTypeInfoResponse
Response class for getting all the resource profiles from the RM.
GetApplicationAttemptReportRequest
The request sent by a client to the `ResourceManager` to get an `ApplicationAttemptReport` for an application attempt.
GetApplicationAttemptReportResponse
The response sent by the `ResourceManager` to a client requesting an application attempt report.
GetApplicationAttemptsRequest
The request from clients to get a list of application attempt reports of an application from the `ResourceManager`.
GetApplicationAttemptsResponse
The response sent by the `ResourceManager` to a client requesting a list of `ApplicationAttemptReport` for application attempts.
GetApplicationReportRequest
The request sent by a client to the `ResourceManager` to get an `ApplicationReport` for an application.
GetApplicationReportResponse
The response sent by the `ResourceManager` to a client requesting an application report.
GetApplicationsRequest
The request from clients to get a report of Applications in the cluster from the `ResourceManager`.
GetApplicationsResponse
The response sent by the `ResourceManager` to a client requesting an `ApplicationReport` for applications.
GetAttributesToNodesRequest
The request from clients to get node to attribute value mapping for all or given set of Node AttributeKey's in the cluster from the `ResourceManager`.
GetAttributesToNodesResponse
The response sent by the `ResourceManager` to a client requesting node to attribute value mapping for all or given set of Node AttributeKey's.
GetClusterMetricsRequest
The request sent by clients to get cluster metrics from the `ResourceManager`.
GetClusterMetricsResponse
The response sent by the `ResourceManager` to a client requesting cluster metrics.
GetClusterNodeAttributesRequest
The request from clients to get node attributes in the cluster from the `ResourceManager`.
GetClusterNodeAttributesResponse
The response sent by the `ResourceManager` to a client requesting a node attributes in cluster.
GetClusterNodeLabelsRequest
GetClusterNodeLabelsResponse
GetClusterNodesRequest
The request from clients to get a report of all nodes in the cluster from the `ResourceManager`.
GetClusterNodesResponse
The response sent by the `ResourceManager` to a client requesting a `NodeReport` for all nodes.
GetContainerReportRequest
The request sent by a client to the `ResourceManager` to get an `ContainerReport` for a container.
GetContainerReportResponse
The response sent by the `ResourceManager` to a client requesting a container report.
GetContainersRequest
The request from clients to get a list of container reports, which belong to an application attempt from the `ResourceManager`.
GetContainersResponse
The response sent by the `ResourceManager` to a client requesting a list of `ContainerReport` for containers.
GetContainerStatusesRequest
The request sent by the `ApplicationMaster` to the `NodeManager` to get `ContainerStatus` of requested containers.
GetContainerStatusesResponse
The response sent by the `NodeManager` to the `ApplicationMaster` when asked to obtain the `ContainerStatus` of requested containers.
GetDelegationTokenRequest
GetDelegationTokenRequest
The request issued by the client to get a delegation token from the `ResourceManager`.
GetDelegationTokenResponse
Response to a `GetDelegationTokenRequest` request from the client.
GetLocalizationStatusesRequest
The request sent by an application master to the node manager to get `LocalizationStatus`es of containers.
GetLocalizationStatusesResponse
The response sent by the node manager to an application master when localization statuses are requested.
GetNewApplicationRequest
The request sent by clients to get a new `ApplicationId` for submitting an application.
GetNewApplicationResponse
The response sent by the `ResourceManager` to the client for a request to get a new `ApplicationId` for submitting applications.
GetNewReservationRequest
The request sent by clients to get a new `ReservationId` for submitting an reservation.
GetNewReservationResponse
The response sent by the `ResourceManager` to the client for a request to get a new `ReservationId` for submitting reservations.
GetNodesToAttributesRequest
The request from clients to get nodes to attributes mapping in the cluster from the `ResourceManager`.
GetNodesToAttributesResponse
The response sent by the `ResourceManager` to a client requesting nodes to attributes mapping.
GetOpParam.Op
Get operations.
GetQueueInfoRequest
The request sent by clients to get queue information from the `ResourceManager`.
GetQueueInfoResponse
The response sent by the `ResourceManager` to a client requesting information about queues in the system.
GetQueueUserAclsInfoRequest
The request sent by clients to the `ResourceManager` to get queue acls for the current user.
GetQueueUserAclsInfoResponse
The response sent by the `ResourceManager` to clients seeking queue acls for the user.
GetResourceProfileRequest
Request class for getting the details for a particular resource profile.
GetResourceProfileResponse
Response class for getting the details for a particular resource profile.
GlobalStorageStatistics
Stores global storage statistics objects.
GlobFilter
A filter for POSIX glob pattern with brace expansions.
GlobFilter
A glob pattern filter for metrics.
GraphiteSink
A metrics sink that writes to a Graphite server.
GroupMappingServiceProvider
An interface for the implementation of a user-to-groups mapping service used by `Groups`.
Gs
GCS implementation of AbstractFileSystem.
GzipCodec
This class creates gzip compressors/decompressors.
HadoopIllegalArgumentException
Indicates that a method has been passed illegal or invalid argument.
HadoopUncaughtExceptionHandler
This class is intended to be installed by calling `Thread.setDefaultUncaughtExceptionHandler(UncaughtExceptionHandler)` in the main entry point.
HAServiceProtocol
Protocol interface that provides High Availability related primitives to monitor and fail-over the service.
HAServiceProtocol.HAServiceState
An HA service may be in active or standby state.
HAServiceProtocol.RequestSource
HAServiceProtocolHelper
Helper for making `HAServiceProtocol` RPC calls.
HAServiceProtocolPB
HAServiceProtocolProtos.HARequestSource
Protobuf enum `hadoop.common.HARequestSource`
HAServiceProtocolProtos.HAServiceStateProto
Protobuf enum `hadoop.common.HAServiceStateProto`
HAServiceTarget
Represents a target of the client side HA administration commands.
HashFunction
Implements a hash object that returns a certain number of hashed values.
HashPartitioner<K2,V2>
Partition keys by their `Object.hashCode()`.
HashPartitioner<K,V>
Partition keys by their `Object.hashCode()`.
HdfsAdmin
The public API for performing administrative functions on HDFS.
HdfsAuditLogger
Extension of `AuditLogger`.
HdfsConstants.DatanodeReportType
HdfsConstants.ReencryptAction
Re-encrypt encryption zone actions.
HdfsConstants.RollingUpgradeAction
HdfsConstants.SafeModeAction
HdfsConstants.StoragePolicy
This enum wraps above Storage Policy ID and name.
HdfsConstants.StoragePolicySatisfierMode
Storage policy satisfier service modes.
HdfsConstants.UpgradeAction
Upgrade actions.
HdfsDataInputStream
The Hdfs implementation of `FSDataInputStream`.
HdfsDataOutputStream
The Hdfs implementation of `FSDataOutputStream`.
HdfsDataOutputStream.SyncFlag
HdfsFileStatus.Flags
Set of features potentially active on an instance.
HdfsProtos.AccessModeProto
File access permissions mode.
HdfsProtos.BlockChecksumTypeProto
Protobuf enum `hadoop.hdfs.BlockChecksumTypeProto`
HdfsProtos.BlockTypeProto
Types of recognized blocks.
HdfsProtos.ChecksumTypeProto
Checksum algorithms/types used in HDFS Make sure this enum's integer values match enum values' id properties defined in org.apache.hadoop.util.DataChecksum.Type
HdfsProtos.CipherSuiteProto
Cipher suite.
HdfsProtos.CryptoProtocolVersionProto
Crypto protocol version used to access encrypted files.
HdfsProtos.DatanodeInfoProto.AdminState
Protobuf enum `hadoop.hdfs.DatanodeInfoProto.AdminState`
HdfsProtos.DatanodeStorageProto.StorageState
Protobuf enum `hadoop.hdfs.DatanodeStorageProto.StorageState`
HdfsProtos.ErasureCodingPolicyState
EC policy state.
HdfsProtos.HdfsFileStatusProto.FileType
Protobuf enum `hadoop.hdfs.HdfsFileStatusProto.FileType`
HdfsProtos.HdfsFileStatusProto.Flags
Protobuf enum `hadoop.hdfs.HdfsFileStatusProto.Flags`
HdfsProtos.StorageTypeProto
Types of recognized storage media.
HdfsServerConstants.BlockUCState
States, which a block can go through while it is under construction.
HdfsServerConstants.NamenodeRole
Defines the NameNode role.
HdfsServerConstants.NodeType
Type of the node
HdfsServerConstants.ReplicaState
Block replica states, which it can go through while being constructed.
HdfsServerConstants.RollingUpgradeStartupOption
Startup options for rolling upgrade.
HdfsServerConstants.StartupOption
Startup options
HdfsServerFederationProtos.MountTableRecordProto.DestOrder
Protobuf enum `hadoop.hdfs.MountTableRecordProto.DestOrder`
HdfsServerProtos.NamenodeCommandProto.Type
Protobuf enum `hadoop.hdfs.NamenodeCommandProto.Type`
HdfsServerProtos.NamenodeRegistrationProto.NamenodeRoleProto
Protobuf enum `hadoop.hdfs.NamenodeRegistrationProto.NamenodeRoleProto`
HdfsServerProtos.NNHAStatusHeartbeatProto.State
Protobuf enum `hadoop.hdfs.NNHAStatusHeartbeatProto.State`
HdfsServerProtos.ReplicaStateProto
State of a block replica at a datanode
HdfsUtils
The public utility API for HDFS.
HealthCheckFailedException
Exception thrown to indicate that health check of a service failed.
HierarchicalTimelineEntity
This class extends timeline entity and defines parent-child relationships with other entities.
HistoryFileManager
This class provides a way to interact with history files in a thread safe manor.
HistoryStorage
Provides an API to query jobs that have finished.
HttpConfig.Policy
HttpFSFileSystem.FILE_TYPE
HttpHeaderConfigurations
Responsible to keep all abfs http headers here.
HttpOperationType
HttpOpParam.Type
Http operation types
HttpQueryParams
Responsible to keep all Http Query params here.
HttpServer2.XFrameOption
The X-FRAME-OPTIONS header in HTTP response to mitigate clickjacking attack.
IAMInstanceCredentialsProvider
This is an IAM credential provider which wraps an `ContainerCredentialsProvider` to provide credentials when the S3A connector is instantiated on AWS EC2 or the AWS container services.
ID
A general identifier, which internally stores the id as an integer.
ID
A general identifier, which internally stores the id as an integer.
IdentityMapper<K,V>
Implements the identity function, mapping inputs directly to outputs.
IdentityReducer<K,V>
Performs no reduction, writing all input values directly to the output.
IdMappingServiceProvider
An interface for the implementation of <userId, userName> mapping and <groupId, groupName> mapping.
ImpersonationProvider
INativeComparable
Any key type that is comparable at native side must implement this interface.
INativeSerializer<T>
an INativeSerializer serializes and deserializes data transferred between Java and native.
IncreaseContainersResourceRequest
The request sent by `Application Master` to the `Node Manager` to change the resource quota of a container.
IncreaseContainersResourceResponse
The response sent by the `NodeManager` to the `ApplicationMaster` when asked to increase container resource.
Index
Deprecated.
Replaced by Avro.
InMemoryAliasMap
InMemoryAliasMap is an implementation of the InMemoryAliasMapProtocol for use with LevelDB.
InnerJoinRecordReader<K extends WritableComparable>
Full inner join.
InnerJoinRecordReader<K extends WritableComparable<?>>
Full inner join.
INodeAttributeProvider
InotifyProtos.EventType
Protobuf enum `hadoop.hdfs.EventType`
InotifyProtos.INodeType
Protobuf enum `hadoop.hdfs.INodeType`
InotifyProtos.MetadataUpdateType
Protobuf enum `hadoop.hdfs.MetadataUpdateType`
InputFormat<K,V>
`InputFormat` describes the input-specification for a Map-Reduce job.
InputFormat<K,V>
`InputFormat` describes the input-specification for a Map-Reduce job.
InputSampler<K,V>
InputSampler<K,V>
Utility for collecting samples and writing a partition file for `TotalOrderPartitioner`.
InputSplit
`InputSplit` represents the data to be processed by an individual `Mapper`.
InputSplit
`InputSplit` represents the data to be processed by an individual `Mapper`.
InputSplitWithLocationInfo
InputStreamType
Enum of input stream types.
InstantiationIOException.Kind
An (extensible) enum of kinds of instantiation failure.
IntegerConfigurationBasicValidator
Integer configuration value Validator.
IntegerSplitter
Implement DBSplitter over integer values.
InterfaceAudience
Annotation to inform users of a package, class or method's intended audience.
InterfaceStability
Annotation to inform users of how much to rely on a particular package, class or method not changing over time.
Interns
Helpers to create interned metrics info.
IntSumReducer<Key>
IntWritable
A WritableComparable for ints.
InvalidAbfsRestOperationException
Exception to wrap invalid Azure service error responses and exceptions raised on network IO.
InvalidAclOperationException
Thrown when there is an attempt to perform an invalid operation on an ACL.
InvalidConfigurationValueException
Thrown when a configuration value is invalid
InvalidFileSystemPropertyException
Thrown when a file system property is invalid.
InvalidFileTypeException
Used when file type differs from the desired file type. like getting a file when a directory is expected.
InvalidIngressServiceException
Exception thrown when an invalid ingress service is encountered.
InvalidInputException
This class wraps a list of problems with the input, so that the user can get a list of problems together instead of finding and fixing them one by one.
InvalidInputException
This class wraps a list of problems with the input, so that the user can get a list of problems together instead of finding and fixing them one by one.
InvalidJobConfException
This exception is thrown when jobconf misses some mendatory attributes or value of some attributes is invalid.
InvalidPathException
Path string is invalid either because it has invalid characters or due to other file system specific reasons.
InvalidPathHandleException
Thrown when the constraints enoded in a `PathHandle` do not hold.
InvalidPathnameException
A path name was invalid.
InvalidRecordException
Raised if an attempt to parse a record failed.
InvalidResourceRequestException.InvalidResourceType
InvalidStateTransitionException
The exception that happens when you call invalid state transition.
InvalidStateTransitonException
Deprecated.
Use `InvalidStateTransitionException` instead.
InvalidUriAuthorityException
Thrown when URI authority is invalid.
InvalidUriException
Thrown when URI is invalid.
InverseMapper<K,V>
A `Mapper` that swaps keys and values.
InverseMapper<K,V>
A `Mapper` that swaps keys and values.
IOStatistics
IO Statistics.
IOStatisticsAggregator
Interface exported by classes which support aggregation of `IOStatistics`.
IOStatisticsLogging
Utility operations convert IO Statistics sources/instances to strings, especially for robustly logging.
IOStatisticsSetters
Setter for IOStatistics entries.
IOStatisticsSnapshot
Snapshot of statistics from a different source.
IOStatisticsSupport
Support for working with IOStatistics.
IOUtils
An utility class for I/O related functionality.
IPList
JavaSerialization
An experimental `Serialization` for Java `Serializable` classes.
JavaSerializationComparator<T extends Serializable & Comparable<T>>
A `RawComparator` that uses a `JavaSerialization` `Deserializer` to deserialize objects that are then compared via their `Comparable` interfaces.
JettyUtils
Contains utility methods and constants relating to Jetty.
Job
Job
The job submitter's view of the Job.
Job.JobState
Job.TaskStatusFilter
JobClient
`JobClient` is the primary interface for the user-job to interact with the cluster.
JobClient.TaskStatusFilter
JobConf
A map/reduce job configuration.
JobConfigurable
That what may be configured.
JobConfPropertyNames
JobContext
JobContext
A read-only view of the job that is provided to the tasks while they are running.
JobControl
JobControl
This class encapsulates a set of MapReduce jobs and its dependency.
JobControl.ThreadState
JobCounter
JobEventType
Event types handled by Job.
JobFinishEvent.Type
JobHistoryParserFactory.VersionDetector
JobID
JobID represents the immutable and unique identifier for the job.
JobID
JobID represents the immutable and unique identifier for the job.
JobInProgress.Counter
Deprecated.
Provided for compatibility.
JobPriority
Used to describe the priority of the running job.
JobPriority
Used to describe the priority of the running job.
JobQueueInfo
Class that contains the information regarding the Job Queues which are maintained by the Hadoop Map/Reduce framework.
JobState
JobStateInternal
JobStatus
Describes the current status of a job.
JobStatus
Describes the current status of a job.
JobStatus.State
Current state of the job
JobTracker.State
`State` is no longer used since M/R 2.x.
JoinRecordReader<K extends WritableComparable>
Base class for Composite joins returning Tuples of arbitrary Writables.
JoinRecordReader<K extends WritableComparable<?>>
Base class for Composite joins returning Tuples of arbitrary Writables.
JournalNodeMXBean
This is the JMX management interface for JournalNode information
KafkaSink
A metrics sink that writes to a Kafka broker.
KerberosAuthException
Thrown when `UserGroupInformation` failed with an unrecoverable error, such as failure in kerberos login/logout, invalid subject etc.
KerberosDelegationTokenAuthenticator
The `KerberosDelegationTokenAuthenticator` provides support for Kerberos SPNEGO authentication mechanism and support for Hadoop Delegation Token operations.
KerberosPrincipal
The kerberos principal of the service.
KeyAuthorizationKeyProvider.KeyOpType
KeyFieldBasedComparator<K,V>
This comparator implementation provides a subset of the features provided by the Unix/GNU Sort.
KeyFieldBasedComparator<K,V>
This comparator implementation provides a subset of the features provided by the Unix/GNU Sort.
KeyFieldBasedPartitioner<K2,V2>
Defines a way to partition keys based on certain key fields (also see `KeyFieldBasedComparator`.
KeyFieldBasedPartitioner<K2,V2>
Defines a way to partition keys based on certain key fields (also see `KeyFieldBasedComparator`.
KeyProvider
A provider of secret key material for Hadoop applications.
KeyProviderFactory
A factory to create a list of KeyProvider based on the path given in a Configuration.
KeyValueLineRecordReader
This class treats a line in the input as a key/value pair separated by a separator character.
KeyValueLineRecordReader
This class treats a line in the input as a key/value pair separated by a separator character.
KeyValueTextInputFormat
An `InputFormat` for plain text files.
KeyValueTextInputFormat
An `InputFormat` for plain text files.
KillApplicationRequest
The request sent by the client to the `ResourceManager` to abort a submitted application.
KillApplicationResponse
The response sent by the `ResourceManager` to the client aborting a submitted application.
KMS.KMSOp
KMSACLs.Type
LaunchableService
An interface which services can implement to have their execution managed by the ServiceLauncher.
LauncherExitCodes
Common Exit codes.
LayoutVersion.Feature
Enums for features that change the layout version before rolling upgrade is supported.
LazyOutputFormat<K,V>
A Convenience class that creates output lazily.
LazyOutputFormat<K,V>
A Convenience class that creates output lazily.
LevelDBFileRegionAliasMap
A LevelDB based implementation of `BlockAliasMap`.
LifecycleEvent
A serializable lifecycle event: the time a state transition occurred, and what state was entered.
LocalFileSystem
Implement the FileSystem API for the checksumed local filesystem.
Locality
LocalizationState
State of localization.
LocalizationStatus
Represents the localization status of a resource.
LocalizationStatus
The status of localization.
LocalResource
`LocalResource` represents a local resource required to run a container.
LocalResourceType
`LocalResourceType` specifies the type of a resource localized by the `NodeManager`.
LocalResourceVisibility
`LocalResourceVisibility` specifies the visibility of a resource localized by the `NodeManager`.
LocatedFileStatus
This class defines a FileStatus that includes a file's block locations.
LogAggregationContext
`LogAggregationContext` represents all of the information needed by the `NodeManager` to handle the logs for an application.
LogAggregationFileController
Base class to implement Log Aggregation File Controller.
LogAggregationStatus
Status of Log aggregation.
LogControl.LogLevel
Enumeration of log levels.
LoggedJob.JobPriority
LoggedJob.JobType
LoggedTaskAttempt.SplitVectorKind
LoggingStateChangeListener
This is a state change listener that logs events at INFO level
LogsCLI
LongSumReducer<K>
A `Reducer` that sums long values.
LongSumReducer<KEY>
LongValueMax
This class implements a value aggregator that maintain the maximum of a sequence of long values.
LongValueMax
This class implements a value aggregator that maintain the maximum of a sequence of long values.
LongValueMin
This class implements a value aggregator that maintain the minimum of a sequence of long values.
LongValueMin
This class implements a value aggregator that maintain the minimum of a sequence of long values.
LongValueSum
This class implements a value aggregator that sums up a sequence of long values.
LongValueSum
This class implements a value aggregator that sums up a sequence of long values.
LongWritable
A WritableComparable for longs.
MagicS3GuardCommitter
This is a dedicated committer which requires the "magic" directory feature of the S3A Filesystem to be enabled; it then uses paths for task and job attempts in magic paths, so as to ensure that the final output goes direct to the destination directory.
ManifestCommitter
This is the Intermediate-Manifest committer.
ManifestCommitterConstants
Public constants for the manifest committer.
ManifestCommitterFactory
This is the committer factory to register as the source of committers for the job/filesystem schema.
ManifestCommitterStatisticNames
Statistic names for committers.
ManifestSuccessData
Summary data saved into a `_SUCCESS` marker file.
MapContext<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
The context that is given to the `Mapper`.
MapFile
A file-based map from keys to values.
MapFileOutputFormat
An `OutputFormat` that writes `MapFile`s.
MapFileOutputFormat
An `OutputFormat` that writes `MapFile`s.
MapHost.State
Mapper<K1,V1,K2,V2>
Maps input key/value pairs to a set of intermediate key/value pairs.
Mapper<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
Maps input key/value pairs to a set of intermediate key/value pairs.
MapReduceBase
Base class for `Mapper` and `Reducer` implementations.
MapRunnable<K1,V1,K2,V2>
Expert: Generic interface for `Mapper`s.
MapRunner<K1,V1,K2,V2>
Default `MapRunnable` implementation.
MapWritable
A Writable Map.
MarkableIterator<VALUE>
`MarkableIterator` is a wrapper iterator class that implements the `MarkableIteratorInterface`.
MarshalledCredentials.CredentialTypeRequired
Enumeration of credential types for use in validation methods.
Master.State
MBeans
This util class provides a method to register an MBean using our standard naming convention as described in the doc for {link `MBeans.register(String, String, Object)`.
MD5Hash
A Writable for MD5 hash values.
MeanStatistic
A mean statistic represented as the sum and the sample count; the mean is calculated on demand.
MetaBlockAlreadyExists
Exception - Meta Block with the same name already exists.
MetaBlockDoesNotExist
Exception - No such Meta Block with the given name.
Metric
Annotation interface for a single metric used to annotate a field or a method in the class.
Metric.Type
MetricFormat
Metrics
Annotation interface for a group of metrics
MetricsCache
A metrics cache for sinks that don't support sparse updates.
MetricsCollector
The metrics collector interface
MetricsException
A general metrics exception wrapper
MetricsFilter
The metrics filter interface.
MetricsInfo
Interface to provide immutable metainfo for metrics.
MetricsJsonBuilder
Build a JSON dump of the metrics.
MetricsPlugin
The plugin interface for the metrics framework
MetricsRecord
An immutable snapshot of metrics with a timestamp
MetricsRecordBuilder
The metrics record builder interface
MetricsRegistry
An optional metrics registry class for creating and maintaining a collection of MetricsMutables, making writing metrics source easier.
MetricsSink
The metrics sink interface.
MetricsSource
The source of metrics information.
MetricsSystem
The metrics system interface.
MetricsSystemMXBean
The JMX interface to the metrics system
MetricsTag
Immutable tag for metrics (for grouping on host/queue/username etc.)
MetricStringBuilder
Build a string dump of the metrics.
MetricsVisitor
A visitor interface for metrics
MetricType
MissingEventsException
MonotonicClock
A monotonic clock from some arbitrary time base in the past, counting in milliseconds, and not affected by settimeofday or similar system clock changes.
MountInterface.MNTPROC
Mount procedures
MoveApplicationAcrossQueuesRequest
The request sent by the client to the `ResourceManager` to move a submitted application to a different queue.
MoveApplicationAcrossQueuesResponse
The response sent by the `ResourceManager` to the client moving a submitted application to a different queue.
MRApps.TaskAttemptStateUI
MRApps.TaskStateUI
MultiFileInputFormat<K,V>
An abstract `InputFormat` that returns `MultiFileSplit`'s in `MultiFileInputFormat.getSplits(JobConf, int)` method.
MultiFileSplit
A sub-collection of input files.
MultiFilterRecordReader<K extends WritableComparable,V extends Writable>
Base class for Composite join returning values derived from multiple sources, but generally not tuples.
MultiFilterRecordReader<K extends WritableComparable<?>,V extends Writable>
Base class for Composite join returning values derived from multiple sources, but generally not tuples.
MultiObjectDeleteException
Exception raised in `S3AFileSystem.deleteObjects(software.amazon.awssdk.services.s3.model.DeleteObjectsRequest)` when one or more of the keys could not be deleted.
MultipartUploader
MultipartUploader is an interface for copying files multipart and across multiple nodes.
MultipartUploaderBuilderImpl<S extends MultipartUploader,B extends org.apache.hadoop.fs.MultipartUploaderBuilder<S,B>>
Builder for `MultipartUploader` implementations.
MultipleArcTransition<OPERAND,EVENT,STATE extends Enum<STATE>>
Hook for Transition.
MultipleInputs
This class supports MapReduce jobs that have multiple input paths with a different `InputFormat` and `Mapper` for each path
MultipleInputs
This class supports MapReduce jobs that have multiple input paths with a different `InputFormat` and `Mapper` for each path
MultipleIOException
Encapsulate a list of `IOException` into an `IOException`
MultipleOutputFormat<K,V>
This abstract class extends the FileOutputFormat, allowing to write the output data to different output files.
MultipleOutputs
The MultipleOutputs class simplifies writing to additional outputs other than the job default output via the `OutputCollector` passed to the `map()` and `reduce()` methods of the `Mapper` and `Reducer` implementations.
MultipleOutputs<KEYOUT,VALUEOUT>
The MultipleOutputs class simplifies writing output data to multiple outputs
MultipleSequenceFileOutputFormat<K,V>
This class extends the MultipleOutputFormat, allowing to write the output data to different output files in sequence file output format.
MultipleTextOutputFormat<K,V>
This class extends the MultipleOutputFormat, allowing to write the output data to different output files in Text output format.
MultithreadedMapper<K1,V1,K2,V2>
Multithreaded implementation for @link org.apache.hadoop.mapreduce.Mapper.
MultithreadedMapRunner<K1,V1,K2,V2>
Multithreaded implementation for `MapRunnable`.
MutableCounter
The mutable counter (monotonically increasing) metric interface
MutableCounterInt
A mutable int counter for implementing metrics sources
MutableCounterLong
A mutable long counter
MutableGauge
The mutable gauge metric interface
MutableGaugeInt
A mutable int gauge
MutableGaugeLong
A mutable long gauge
MutableInverseQuantiles
Watches a stream of long values, maintaining online estimates of specific quantiles with provably low error bounds.
MutableMetric
The mutable metric interface
MutableQuantiles
Watches a stream of long values, maintaining online estimates of specific quantiles with provably low error bounds.
MutableRate
A convenient mutable metric for throughput measurement
MutableRates
Helper class to manage a group of mutable rate metrics This class synchronizes all accesses to the metrics it contains, so it should not be used in situations where there is high contention on the metrics.
MutableRatesWithAggregation
Helper class to manage a group of mutable rate metrics.
MutableRollingAverages
This class maintains a group of rolling average metrics.
MutableStat
A mutable metric with stats.
MySQLDataDrivenDBRecordReader<T extends DBWritable>
A RecordReader that reads records from a MySQL table via DataDrivenDBRecordReader
MySQLDBRecordReader<T extends DBWritable>
A RecordReader that reads records from a MySQL table.
NameNode.OperationCategory
Categories of operations supported by the namenode.
NameNodeLayoutVersion.Feature
Enums for features that change the layout version.
NamespaceInfo.Capability
NativeAzureFileSystem
Deprecated.
NativeIO.POSIX.SupportState
Keeps the support state of PMDK.
NativeIO.Windows.AccessRight
Supported list of Windows access right flags
Nfs3Constant.NFSPROC3
Nfs3Constant.WriteStableHow
Write call flavors
NfsFileType
Class encapsulates different types of files
NLineInputFormat
NLineInputFormat which splits N lines of input as one split.
NLineInputFormat
NLineInputFormat which splits N lines of input as one split.
NMClient
NMClient.UpgradeOp
NMClientAsync
`NMClientAsync` handles communication with all the NodeManagers and provides asynchronous updates on getting responses from them.
NMClientAsyncImpl.ContainerEventType
The type of the event of interacting with a container
NMClientAsyncImpl.ContainerState
NMProxy
NMToken
The NMToken is used for authenticating communication with `NodeManager`
NMTokenCache
NMTokenCache manages NMTokens required for an Application Master communicating with individual NodeManagers.
NMTokenIdentifier
NNStorage.NameNodeDirType
Implementation of StorageDirType specific to namenode storage A Storage directory could be of type IMAGE which stores only fsimage, or of type EDITS which stores edits or of type IMAGE_AND_EDITS which stores both fsimage and edits.
NNStorage.NameNodeFile
The filenames used for storing the images.
NoChildrenForEphemeralsException
This is a manifestation of the Zookeeper restrictions about what nodes may act as parents.
NodeAttribute
Node Attribute is a kind of a label which represents one of the attribute/feature of a Node.
NodeAttributeInfo
Node Attribute Info describes a NodeAttribute.
NodeAttributeKey
Node AttributeKey uniquely identifies a given Node Attribute.
NodeAttributeOpCode
Enumeration of various node attribute op codes.
NodeAttributeType
Type of a `node Attribute`.
NodeId
`NodeId` is the unique identifier for a node.
NodeLabel
NodeLabelsStoreEventType
NodeReport
`NodeReport` is a summary of runtime information of a node in the cluster.
NodeState
State of a `Node`.
NodeToAttributeValue
Mapping of Attribute Value to a Node.
NodeUpdateType
Taxonomy of the `NodeState` that a `Node` might transition into.
NoRecordException
Raised if there is no `ServiceRecord` resolved at the end of the specified path.
NotInMountpointException
NotInMountpointException extends the UnsupportedOperationException.
NoVersionAttributeException
Indicates the S3 object does not provide the versioning attribute required by the configured change detection policy.
NSQuotaExceededException
NullBlockAliasMap
Null sink for region information emitted from FSImage.
NullOutputFormat<K,V>
Consume all outputs and put them in /dev/null.
NullOutputFormat<K,V>
Consume all outputs and put them in /dev/null.
NullWritable
Singleton Writable with no data.
NumberReplicas.StoredReplicaState
OAuth2ConnectionConfigurator
Configure a connection to use OAuth2 authentication.
OAuth2Constants
Sundry constants relating to OAuth2 within WebHDFS.
ObjectWritable
A polymorphic Writable that writes an instance with it's class name.
OBS
OBS implementation of AbstractFileSystem, which delegates to the `OBSFileSystem`.
OpenFilesIterator.OpenFilesType
Open file types to filter the results.
OperationDuration
Little duration counter.
Options
This class contains options related to file system operations.
Options.ChecksumCombineMode
Enum for indicating what mode to use when combining chunk and block checksums to define an aggregate FileChecksum.
Options.CreateFileOptionKeys
The standard `createFile()` options.
Options.OpenFileOptions
The standard `openFile()` options.
Options.Rename
Enum to support the varargs for rename() options
OracleDataDrivenDBInputFormat<T extends DBWritable>
A InputFormat that reads input data from an SQL table in an Oracle db.
OracleDataDrivenDBRecordReader<T extends DBWritable>
A RecordReader that reads records from a Oracle table via DataDrivenDBRecordReader
OracleDateSplitter
Implement DBSplitter over date/time values returned by an Oracle db.
OracleDBRecordReader<T extends DBWritable>
A RecordReader that reads records from an Oracle SQL table.
OuterJoinRecordReader<K extends WritableComparable>
Full outer join.
OuterJoinRecordReader<K extends WritableComparable<?>>
Full outer join.
OutputCollector<K,V>
Collects the `<key, value>` pairs output by `Mapper`s and `Reducer`s.
OutputCommitter
`OutputCommitter` describes the commit of task output for a Map-Reduce job.
OutputCommitter
`OutputCommitter` describes the commit of task output for a Map-Reduce job.
OutputFormat<K,V>
`OutputFormat` describes the output-specification for a Map-Reduce job.
OutputFormat<K,V>
`OutputFormat` describes the output-specification for a Map-Reduce job.
OutputLogFilter
This class filters log files from directory given It doesnt accept paths having _logs.
OverrideRecordReader<K extends WritableComparable,V extends Writable>
Prefer the "rightmost" data source for this key.
OverrideRecordReader<K extends WritableComparable<?>,V extends Writable>
Prefer the "rightmost" data source for this key.
ParentNotDirectoryException
Indicates that the parent of specified Path is not a directory as expected.
Parser
Very simple shift-reduce parser for join expressions.
Parser
Very simple shift-reduce parser for join expressions.
Parser.Node
Parser.Node
Parser.NodeToken
Parser.NodeToken
Parser.NumToken
Parser.NumToken
Parser.StrToken
Parser.StrToken
Parser.Token
Tagged-union type for tokens from the join expression.
Parser.Token
Tagged-union type for tokens from the join expression.
Parser.TType
Parser.TType
PartHandle
Opaque, serializable reference to a part id for multipart uploads.
PartialFileOutputCommitter
An `OutputCommitter` that commits files specified in job output directory i.e.
PartialListing<T extends FileStatus>
A partial listing of the children of a parent directory.
PartialOutputCommitter
Interface for an `OutputCommitter` implementing partial commit of task output, as during preemption.
Partitioner<K2,V2>
Partitions the key space.
Partitioner<KEY,VALUE>
Partitions the key space.
PassthroughCodec
This is a special codec which does not transform the output.
Path
Names a file or directory in a `FileSystem`.
PathData.FileTypeRequirement
PathData.PathType
PathFilter
PathHandle
Opaque, serializable reference to an entity in the FileSystem.
PathOutputCommitter
A committer which somehow commits data written to a working directory to the final directory during the commit process.
PathOutputCommitterFactory
A factory for committers implementing the `PathOutputCommitter` methods, and so can be used from `FileOutputFormat`.
Pentomino.SolutionCategory
Phase
PipelineAck.ECN
PipelineAck.SLOW
PlacementConstraint
`PlacementConstraint` represents a placement constraint for a resource allocation.
PlacementConstraint
Placement constraint details.
PlacementConstraint.TargetExpression.TargetType
Enum specifying the type of the target expression.
PlacementConstraint.TimedPlacementConstraint.DelayUnit
The unit of scheduling delay.
PlacementConstraintParser
Placement constraint expression parser.
PlacementConstraints
This class contains various static methods for the applications to create placement constraints (see also `PlacementConstraint`).
PlacementPolicy
Advanced placement policy of the components of a service.
PlacementScope
The scope of placement for the containers of a component.
PlacementType
The type of placement - affinity/anti-affinity/affinity-with-cardinality with containers of another component or containers of the same component (self).
Platform
Base class for platforms.
PositionedReadable
Stream that permits positional reading.
PostOpParam.Op
Post operations.
Pre21JobHistoryConstants.Values
This enum contains some of the values commonly used by history log events.
PreemptionContainer
Specific container requested back by the `ResourceManager`.
PreemptionContract
Description of resources requested back by the `ResourceManager`.
PreemptionMessage
A `PreemptionMessage` is part of the RM-AM protocol, and it is used by the RM to specify resources that the RM wants to reclaim from this `ApplicationMaster` (AM).
PreemptionResourceRequest
Description of resources requested back by the cluster.
Priority
The priority assigned to a ResourceRequest or Application or Container allocation
PrivilegedEntity.EntityType
ProcessingDetails.Timing
The different stages to track the time of.
ProfileAWSCredentialsProvider
Progressable
A facility for reporting progress.
ProgressListenerEvent
Enum for progress listener events.
ProtocolTypes
some common protocol types
PseudoDelegationTokenAuthenticator
The `PseudoDelegationTokenAuthenticator` provides support for Hadoop's pseudo authentication mechanism that accepts the user name specified as a query string parameter and support for Hadoop Delegation Token operations.
PureJavaCrc32
A pure-java implementation of the CRC32 checksum that uses the same polynomial as the built-in native CRC32.
PureJavaCrc32C
A pure-java implementation of the CRC32 checksum that uses the CRC32-C polynomial, the same polynomial used by iSCSI and implemented on many Intel chipsets supporting SSE4.2.
PutOpParam.Op
Put operations.
QueueACL
`QueueACL` enumerates the various ACLs for queues.
QueueAclsInfo
Class to encapsulate Queue ACLs for a particular user.
QueueEntity
This entity represents a queue.
QueueInfo
Class that contains the information regarding the Job Queues which are maintained by the Hadoop Map/Reduce framework.
QueueInfo
QueueInfo is a report of the runtime information of the queue.
QueueState
Enum representing queue state
QueueState
State of a Queue.
QueueStatistics
QueueUserACLInfo
`QueueUserACLInfo` provides information `QueueACL` for the given user.
Quota
Quota types.
QuotaByStorageTypeExceededException
QuotaExceededException
This exception is thrown when modification to HDFS results in violation of a directory quota.
QuotaUsage
Store the quota usage of a directory.
RawComparable
Interface for objects that can be compared through `RawComparator`.
RawComparator<T>
A `Comparator` that operates directly on byte representations of objects.
RawLocalFileSystem
Implement the FileSystem API for the raw local filesystem.
ReadBufferStatus
The ReadBufferStatus for Rest AbfsClient
ReadinessCheck
A custom command or a pluggable helper container to determine the readiness of a container of a component.
ReadinessCheck.TypeEnum
Type.
ReadOption
Options that can be used when reading from a FileSystem.
ReadType
Enumeration for different types of read operations triggered by AbfsInputStream.
ReceivedDeletedBlockInfo.BlockStatus
ReconfigurationProtocolPB
Protocol that clients use to communicate with the NN/DN to do reconfiguration on the fly.
Record
Deprecated.
Replaced by Avro.
RecordComparator
Deprecated.
Replaced by Avro.
RecordInput
Deprecated.
Replaced by Avro.
RecordOutput
Deprecated.
Replaced by Avro.
RecordReader<K,V>
`RecordReader` reads <key, value> pairs from an `InputSplit`.
RecordReader<KEYIN,VALUEIN>
The record reader breaks the data into key/value pairs for input to the `Mapper`.
RecordWriter<K,V>
`RecordWriter` writes the output <key, value> pairs to an output file.
RecordWriter<K,V>
`RecordWriter` writes the output <key, value> pairs to an output file.
ReduceContext<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
The context passed to the `Reducer`.
Reducer<K2,V2,K3,V3>
Reduces a set of intermediate values which share a key to a smaller set of values.
Reducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
Reduces a set of intermediate values which share a key to a smaller set of values.
ReflectionUtils
General reflection utils
RegexFilter
A regex pattern filter for metrics
RegexMapper<K>
A `Mapper` that extracts text matching a regular expression.
RegexMapper<K>
A `Mapper` that extracts text matching a regular expression.
RegexMountPointInterceptorType
RegexMountPointInterceptorType.
RegisterApplicationMasterRequest
The request sent by the `ApplicationMaster` to `ResourceManager` on registration.
RegisterApplicationMasterResponse
The response sent by the `ResourceManager` to a new `ApplicationMaster` on registration.
RegistryAdminService.PurgePolicy
Policy to purge entries
RegistryBindingSource
Interface which can be implemented by a registry binding source
RegistryConstants
Constants for the registry, including configuration keys and default values.
RegistryIOException
Base exception for registry operations.
RegistryOperations
Registry Operations
RegistryOperationsClient
This is the client service for applications to work with the registry.
RegistryOperationsService
The Registry operations service.
RegistryPathStatus
Output of a `RegistryOperations.stat()` call
RegistryTypeUtils
Static methods to work with registry types —primarily endpoints and the list representation of addresses.
RegistryUtils
Utility methods for working with a registry.
RehashPartitioner<K,V>
This partitioner rehashes values returned by `Object.hashCode()` to get smoother distribution between partitions which may improve reduce reduce time in some cases and should harm things in no cases.
ReInitializeContainerRequest
This encapsulates all the required fields needed for a Container ReInitialization.
ReInitializeContainerResponse
The response to the `ReInitializeContainerRequest`.
RejectedSchedulingRequest
This encapsulates a Rejected SchedulingRequest.
RejectionReason
Reason for rejecting a Scheduling Request.
ReleaseSharedCacheResourceRequest
The request from clients to release a resource in the shared cache.
ReleaseSharedCacheResourceResponse
The response to clients from the `SharedCacheManager` when releasing a resource in the shared cache.
RemoteFileChangedException
Indicates the S3 object is out of sync with the expected version.
RemoteIterators
A set of remote iterators supporting transformation and filtering, with IOStatisticsSource passthrough, and of conversions of the iterators to lists/arrays and of performing actions on the values.
RemoveScheme
Defines the different remove scheme for retouched Bloom filters.
RenewDelegationTokenRequest
The request issued by the client to renew a delegation token from the `ResourceManager`.
RenewDelegationTokenResponse
The response to a renewDelegationToken call to the `ResourceManager`.
ReplaceDatanodeOnFailure.Policy
The replacement policies
ReplicaAccessor
The public API for ReplicaAccessor objects.
ReplicaAccessorBuilder
The public API for creating a new ReplicaAccessor.
ReplicatedBlockStats
Get statistics pertaining to blocks of type `BlockType.CONTIGUOUS` in the filesystem.
Reporter
A facility for Map-Reduce applications to report progress and update counters, status information etc.
ReservationACL
`ReservationACL` enumerates the various ACLs for reservations.
ReservationAllocationState
`ReservationAllocationState` represents the reservation that is made by a user.
ReservationDefinition
`ReservationDefinition` captures the set of resource and time constraints the user cares about regarding a reservation.
ReservationDeleteRequest
`ReservationDeleteRequest` captures the set of requirements the user has to delete an existing reservation.
ReservationDeleteResponse
`ReservationDeleteResponse` contains the answer of the admission control system in the `ResourceManager` to a reservation delete operation.
ReservationId
`ReservationId` represents the globally unique identifier for a reservation.
ReservationListRequest
`ReservationListRequest` captures the set of requirements the user has to list reservations.
ReservationListResponse
`ReservationListResponse` captures the list of reservations that the user has queried.
ReservationRequest
`ReservationRequest` represents the request made by an application to the `ResourceManager` to reserve `Resource`s.
ReservationRequest.ReservationRequestComparator
ReservationRequestInterpreter
Enumeration of various types of dependencies among multiple `ReservationRequests` within one `ReservationDefinition` (from least constraining to most constraining).
ReservationRequests
`ReservationRequests` captures the set of resource and constraints the user cares about regarding a reservation.
ReservationSubmissionRequest
`ReservationSubmissionRequest` captures the set of requirements the user has to create a reservation.
ReservationSubmissionResponse
The response sent by the `ResourceManager` to a client on reservation submission.
ReservationUpdateRequest
`ReservationUpdateRequest` captures the set of requirements the user has to update an existing reservation.
ReservationUpdateResponse
`ReservationUpdateResponse` contains the answer of the admission control system in the `ResourceManager` to a reservation update operation.
ResetableIterator<T extends Writable>
This defines an interface to a stateful Iterator that can replay elements added to it directly.
ResetableIterator<T extends Writable>
This defines an interface to a stateful Iterator that can replay elements added to it directly.
Resource
`Resource` models a set of computer resources in the cluster.
Resource
Resource determines the amount of resources (vcores, memory, network, etc.)
ResourceAllocationRequest
`ResourceAllocationRequest` represents an allocation made for a reservation for the current state of the plan.
ResourceBlacklistRequest
`ResourceBlacklistRequest` encapsulates the list of resource-names which should be added or removed from the blacklist of resources for the application.
ResourceCalculatorProcessTree
Interface class to obtain process resource usage NOTE: This class should not be used by external users, but only by external developers to extend and include their own process-tree implementation, especially for platforms other than Linux and Windows.
ResourceLocalizationRequest
The request sent by the ApplicationMaster to ask for localizing resources.
ResourceLocalizationResponse
The response to the `ResourceLocalizationRequest`
ResourceNotFoundException
This exception is thrown when details of an unknown resource type are requested.
ResourceOption
ResourceRequest
`ResourceRequest` represents the request made by an application to the `ResourceManager` to obtain various `Container` allocations.
ResourceRequest.ResourceRequestBuilder
Class to construct instances of `ResourceRequest` with specific options.
ResourceRequest.ResourceRequestComparator
ResourceSizing
`ResourceSizing` contains information for the size of a `SchedulingRequest`, such as the number of requested allocations and the resources for each allocation.
ResourceTypes
Enum which represents the resource type.
ResourceUtilization
`ResourceUtilization` models the utilization of a set of computer resources in the cluster.
RestartContainerResponse
The response to a restart Container request.
RestCsrfPreventionFilter
This filter provides protection against cross site request forgery (CSRF) attacks for REST APIs.
RetouchedBloomFilter
Implements a retouched Bloom filter, as defined in the CoNEXT 2006 paper.
RetryPolicy.RetryAction.RetryDecision
RetryValue
Enum for retry values.
RMDelegationTokenIdentifier
Delegation Token Identifier that identifies the delegation tokens from the Resource Manager.
RMDelegationTokenSelector
RMProxy<T>
RoleModel.Effects
Effect options.
RollbackResponse
Response to a Rollback request.
RollingFileSystemSink
This class is a metrics sink that uses `FileSystem` to write the metrics logs.
RouterFederationRename.RouterRenameOption
RouterServiceState
States of the Router.
RPC.RpcKind
RpcAcceptedReply.AcceptState
RpcAuthInfo.AuthFlavor
Different types of authentication as defined in RFC 1831
RpcDeniedReply.RejectState
RpcHeaderProtos.RpcKindProto
RpcKind determine the rpcEngine and the serialization of the rpc request
RpcHeaderProtos.RpcRequestHeaderProto.OperationProto
Protobuf enum `hadoop.common.RpcRequestHeaderProto.OperationProto`
RpcHeaderProtos.RpcResponseHeaderProto.RpcErrorCodeProto
Protobuf enum `hadoop.common.RpcResponseHeaderProto.RpcErrorCodeProto`
RpcHeaderProtos.RpcResponseHeaderProto.RpcStatusProto
Protobuf enum `hadoop.common.RpcResponseHeaderProto.RpcStatusProto`
RpcHeaderProtos.RpcSaslProto.SaslState
Protobuf enum `hadoop.common.RpcSaslProto.SaslState`
RpcMessage.Type
Message type
RpcReply.ReplyState
RPC reply_stat as defined in RFC 1831
RunningJob
`RunningJob` is the user-interface to query for details on a running Map-Reduce job.
RwLockMode
This lock mode is used for FGL.
S3A
S3A implementation of AbstractFileSystem.
S3ADelegationTokens.TokenIssuingPolicy
How will tokens be issued on request?
S3AEncryptionMethods
This enum is to centralize the encryption methods and the value required in the configuration.
S3LogParser
Class to help parse AWS S3 Logs.
SafeModeAction
An identical copy from org.apache.hadoop.hdfs.protocol.HdfsConstants.SafeModeAction, that helps the other file system implementation to define `SafeMode`.
SaslRpcServer.AuthMethod
Authentication method
SaslRpcServer.QualityOfProtection
SchedConfCLI
CLI for modifying scheduler configuration.
SchedulerSecurityInfo
SchedulingRequest
`SchedulingRequest` represents a request made by an application to the `ResourceManager` to obtain an allocation.
SchedulingRequest.SchedulingRequestBuilder
Class to construct instances of `SchedulingRequest` with specific options.
ScriptBasedMapping
This class implements the `DNSToSwitchMapping` interface using a script configured via the `CommonConfigurationKeysPublic.NET_TOPOLOGY_SCRIPT_FILE_NAME_KEY` option.
SecretManager<T extends TokenIdentifier>
The server-side secret manager for each token type.
SecurityUtil
Security Utils.
Seekable
Stream that permits seeking.
SelectConstants
Deprecated.
SequenceFile
`SequenceFile`s are flat files consisting of binary key/value pairs.
SequenceFile.CompressionType
The compression type used to compress key/value pairs in the `SequenceFile`.
SequenceFileAsBinaryInputFormat
InputFormat reading keys, values from SequenceFiles in binary (raw) format.
SequenceFileAsBinaryInputFormat
InputFormat reading keys, values from SequenceFiles in binary (raw) format.
SequenceFileAsBinaryOutputFormat
An `OutputFormat` that writes keys, values to `SequenceFile`s in binary(raw) format
SequenceFileAsBinaryOutputFormat
An `OutputFormat` that writes keys, values to `SequenceFile`s in binary(raw) format
SequenceFileAsTextInputFormat
This class is similar to SequenceFileInputFormat, except it generates SequenceFileAsTextRecordReader which converts the input keys and values to their String forms by calling toString() method.
SequenceFileAsTextInputFormat
This class is similar to SequenceFileInputFormat, except it generates SequenceFileAsTextRecordReader which converts the input keys and values to their String forms by calling toString() method.
SequenceFileAsTextRecordReader
This class converts the input keys and values to their String forms by calling toString() method.
SequenceFileAsTextRecordReader
This class converts the input keys and values to their String forms by calling toString() method.
SequenceFileInputFilter<K,V>
A class that allows a map/red job to work on a sample of sequence files.
SequenceFileInputFilter<K,V>
A class that allows a map/red job to work on a sample of sequence files.
SequenceFileInputFormat<K,V>
An `InputFormat` for `SequenceFile`s.
SequenceFileInputFormat<K,V>
An `InputFormat` for `SequenceFile`s.
SequenceFileOutputFormat<K,V>
An `OutputFormat` that writes `SequenceFile`s.
SequenceFileOutputFormat<K,V>
An `OutputFormat` that writes `SequenceFile`s.
SequenceFileRecordReader<K,V>
An `RecordReader` for `SequenceFile`s.
SequenceFileRecordReader<K,V>
An `RecordReader` for `SequenceFile`s.
SerialNumberManager
Manage name-to-serial-number maps for various string tables.
Server
An abstract IPC service.
ServerProxy
Servers
Helpers to handle server addresses
Service
Service LifeCycle.
Service
An Service resource has the following attributes.
Service.STATE
Service states
ServiceApiConstants
This class defines constants that can be used in input spec for variable substitutions
ServiceClient
ServiceEventType
Types of `ServiceEvent`.
ServiceFailedException
Exception thrown to indicate that an operation performed to modify the state of a service or application failed.
ServiceLaunchException
A service launch exception that includes an exit code.
ServiceManager.State
State of `ServiceManager`.
ServiceOperations
This class contains a set of methods to work with services, especially to walk them through their lifecycle.
ServiceRecord
JSON-marshallable description of a single component.
ServiceState
The current state of an service.
ServiceStateChangeListener
Interface to notify state changes of a service.
ServiceStateException
Exception that can be raised on state change operations, whose exit code can be explicitly set, determined from that of any nested cause, or a default value of `LauncherExitCodes.EXIT_SERVICE_LIFECYCLE_EXCEPTION`.
ServiceStateModel
Implements the service state model.
ServiceStatus
The current status of a submitted service, returned as a response to the GET API.
ServiceTimelineEntityType
Slider entities that are published to ATS.
ServiceTimelineEvent
Events that are used to store in ATS.
SetAttr3.SetAttrField
SetFile
A file-based set of keys.
SharedCacheChecksum
SharedCacheChecksumFactory
SharedCacheClient
This is the client for YARN's shared cache.
SharedInstanceCredentialProvider
This credential provider has jittered between existing and non-existing, but it turns up in documentation enough that it has been restored.
Shell
A base class for running a Shell command.
Shell.OSType
ShellContainerCommand
Enumeration of various signal container commands.
ShortWritable
A WritableComparable for shorts.
ShutdownHookManager
The `ShutdownHookManager` enables running shutdownHook in a deterministic order, higher priority first.
SignalContainerCommand
Enumeration of various signal container commands.
SignalContainerRequest
The request sent by the client to the `ResourceManager` or by the `ApplicationMaster` to the `NodeManager` to signal a container.
SignalContainerResponse
The response sent by the `ResourceManager` to the client signalling a container.
SimpleAWSCredentialsProvider
Support simple credentials for authenticating with AWS.
SingleArcTransition<OPERAND,EVENT>
Hook for Transition.
SingleUGIResolver
Map all owners/groups in external system to a single user in FSImage.
Sizes
Sizes of binary values and other some common sizes.
SkipBadRecords
Utility class for skip bad records functionality.
SlowDiskReports.DiskOp
Lists the types of operations on which disk latencies are measured.
SLSRunner.TraceType
The type of trace in input.
SnapshotDiffReport.DiffType
Types of the difference, which include CREATE, MODIFY, DELETE, and RENAME.
SocksSocketFactory
Specialized SocketFactory to create sockets with a SOCKS proxy
SortedMapWritable<K extends WritableComparable<? super K>>
A Writable SortedMap.
Speculator.EventType
SplitCompressionInputStream
An InputStream covering a range of compressed data.
SplitLocationInfo
SplittableCompressionCodec
This interface is meant to be implemented by those compression codecs which are capable to compress / de-compress a stream starting at any arbitrary position.
SplittableCompressionCodec.READ_MODE
During decompression, data can be read off from the decompressor in two modes, namely continuous and blocked.
SSLConnectionConfigurator
Configure a connection to use SSL authentication.
StandardSocketFactory
Specialized SocketFactory to create sockets with a SOCKS proxy
StartContainerRequest
The request sent by the `ApplicationMaster` to the `NodeManager` to start a container.
StartContainersRequest
The request which contains a list of `StartContainerRequest` sent by the `ApplicationMaster` to the `NodeManager` to start containers.
StartContainersResponse
The response sent by the `NodeManager` to the `ApplicationMaster` when asked to start an allocated container.
State
StateMachine<STATE extends Enum<STATE>,EVENTTYPE extends Enum<EVENTTYPE>,EVENT>
StateMachineFactory<OPERAND,STATE extends Enum<STATE>,EVENTTYPE extends Enum<EVENTTYPE>,EVENT>
State machine topology.
StateStoreBaseImpl
Base implementation of a State Store driver.
StateStoreDriver
Driver class for an implementation of a `StateStoreService` provider.
StateStoreSerializableImpl
State Store driver that stores a serialization of the records.
StateTransitionListener<OPERAND,EVENT,STATE extends Enum<STATE>>
A State Transition Listener.
Statistic
Statistic which are collected in S3A.
StatisticTypeEnum
Enum for statistic types.
StatisticTypeEnum
Enum of statistic types.
StatsDSink
A metrics sink that writes metrics to a StatsD daemon.
StopContainersRequest
The request sent by the `ApplicationMaster` to the `NodeManager` to stop containers.
StopContainersResponse
The response sent by the `NodeManager` to the `ApplicationMaster` when asked to stop allocated containers.
Storage.StorageState
StorageStatistics
StorageStatistics contains statistics data for a FileSystem or FileContext instance.
StorageType
Defines the types of supported storage media.
StorageUnit
Class that maintains different forms of Storage Units.
StoreStatisticNames
Common statistic names for object store operations..
StreamBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
StreamBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
StreamCapabilities
Interface to query streams for supported capabilities.
StreamCapabilities.StreamCapability
Deprecated.
StreamCapabilitiesPolicy
Static methods to implement policies for `StreamCapabilities`.
StreamFactoryRequirements.Requirements
Requirements a factory may have.
StreamStatisticNames
These are common statistic names.
StrictPreemptionContract
Enumeration of particular allocations to be reclaimed.
Stringifier<T>
Stringifier interface offers two methods to convert an object to a string representation and restore the object given its string representation.
StringInterner
Provides string interning utility methods.
StringUtils.TraditionalBinaryPrefix
The traditional binary prefixes, kilo, mega, ..., exa, which can be represented by a 64-bit integer.
StringValueMax
This class implements a value aggregator that maintain the biggest of a sequence of strings.
StringValueMax
This class implements a value aggregator that maintain the biggest of a sequence of strings.
StringValueMin
This class implements a value aggregator that maintain the smallest of a sequence of strings.
StringValueMin
This class implements a value aggregator that maintain the smallest of a sequence of strings.
SubApplicationEntity
This entity represents a user defined entities to be stored under sub application table.
SubmitApplicationRequest
The request sent by a client to submit an application to the `ResourceManager`.
SubmitApplicationResponse
The response sent by the `ResourceManager` to a client on application submission.
Submitter
The main entry point and job submitter.
SWebHdfs
AbstractFileSystem implementation for HDFS over the web (secure).
Syncable
This is the interface for flush/sync operations.
SysInfo
Plugin to calculate resource information on the system.
SystemClock
Implementation of `Clock` that gives the current time from the system clock in milliseconds.
TableListing.Justification
TableMapping
Simple `DNSToSwitchMapping` implementation that reads a 2 column text file.
Task.Counter
Deprecated.
Provided for compatibility.
TaskAttemptCompletionEventStatus
TaskAttemptContext
TaskAttemptContext
The context for task attempts.
TaskAttemptEventType
Event types handled by TaskAttempt.
TaskAttemptID
TaskAttemptID represents the immutable and unique identifier for a task attempt.
TaskAttemptID
TaskAttemptID represents the immutable and unique identifier for a task attempt.
TaskAttemptState
TaskCompletionEvent
This is used to track task completion events on job tracker.
TaskCompletionEvent
This is used to track task completion events on job tracker.
TaskCompletionEvent.Status
TaskCompletionEvent.Status
TaskCounter
TaskEventType
Event types handled by Task.
TaskID
TaskID represents the immutable and unique identifier for a Map or Reduce Task.
TaskID
TaskID represents the immutable and unique identifier for a Map or Reduce Task.
TaskInputOutputContext<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
A context object that allows input and output from the task.
TaskReport
A report on the state of a task.
TaskState
TaskStateInternal
TaskStatus.State
Possible Task States.
TaskTrackerInfo
Information about TaskTracker.
TaskType
Define MaWo Task Type.
TaskType
Enum for map, reduce, job-setup, job-cleanup, task-cleanup task types.
TaskType
TemporaryAWSCredentialsProvider
Support session credentials for authenticating with AWS.
TeraGen.Counters
Text
This class stores text using standard UTF8 encoding.
TextFileRegionAliasMap
This class is used for block maps stored as text files, with a specified delimiter.
TextInputFormat
An `InputFormat` for plain text files.
TextInputFormat
An `InputFormat` for plain text files.
TextOutputFormat<K,V>
An `OutputFormat` that writes plain text files.
TextOutputFormat<K,V>
An `OutputFormat` that writes plain text files.
TextSplitter
Implement DBSplitter over text strings.
TFile
A TFile is a container of key-value pairs.
TimelineAbout
TimelineClient
A client library that can be used to post some information in terms of a number of conceptual entities.
TimelineDelegationTokenIdentifier
TimelineDelegationTokenResponse
The response of delegation token related request
TimelineDelegationTokenSelector
TimelineDomain
This class contains the information about a timeline domain, which is used to a user to host a number of timeline entities, isolating them from others'.
TimelineDomain
This class contains the information about a timeline service domain, which is used to a user to host a number of timeline entities, isolating them from others'.
TimelineDomains
The class that hosts a list of timeline domains.
TimelineEntities
The class that hosts a list of timeline entities.
TimelineEntities
This class hosts a set of timeline entities.
TimelineEntity
The class that contains the the meta information of some conceptual entity and its related events.
TimelineEntity
The basic timeline entity data structure for timeline service v2.
TimelineEntityGroupId
`TimelineEntityGroupId` is an abstract way for timeline service users to represent “a group of related timeline data.
TimelineEntityType
Defines type of entity.
TimelineEvent
The class that contains the information of an event that is related to some conceptual entity of an application.
TimelineEvent
This class contains the information of an event that belongs to an entity.
TimelineEvents
The class that hosts a list of events, which are categorized according to their related entities.
TimelineEvents.EventsOfOneEntity
The class that hosts a list of events that are only related to one entity.
TimelineHealth
This class holds health information for ATS.
TimelineHealth.TimelineHealthStatus
Timline health status.
TimelineMetric
This class contains the information of a metric that is related to some entity.
TimelineMetric.Type
Type of metric.
TimelineMetricOperation
Aggregation operations.
TimelinePutResponse
A class that holds a list of put errors.
TimelinePutResponse.TimelinePutError
A class that holds the error code for one entity.
TimelineReaderClient
A client library that can be used to get Timeline Entities associated with application, application attempt or containers.
TimelineReaderClientImpl
Implementation of TimelineReaderClient interface.
TimelineUtils
The helper class for the timeline module.
TimelineWriteResponse
A class that holds a list of put errors.
TimelineWriteResponse.TimelineWriteError
A class that holds the error code for one entity.
TimeoutException
Thrown when a timeout happens.
TimerFunctionality
Class for Timer Functionality.
Token<T extends TokenIdentifier>
The client-side form of the token.
Token
`Token` is the security entity used by the framework to verify authenticity of any resource.
Token.TrivialRenewer
A trivial renewer for token kinds that aren't managed.
TokenCache
This class provides user facing APIs for transferring secrets from the job client to the tasks.
TokenCounterMapper
Tokenize the input values and emit each word with a count of 1.
TokenCountMapper<K>
A `Mapper` that maps text values into <token,freq> pairs.
TokenIdentifier
An identifier that identifies a token, may contain public information about a token, including its kind (or type).
TokenInfo
Indicates Token related information to be used
TokenRenewer
This is the interface for plugins that handle tokens.
TokenSelector<T extends TokenIdentifier>
Select token of type T from tokens for use with named service
Tool
A tool interface that supports handling of generic command-line options.
ToolRunner
A utility to help run `Tool`s.
TotalOrderPartitioner<K,V>
Partitioner effecting a total order by reading split points from an externally generated source.
TotalOrderPartitioner<K,V>
Partitioner effecting a total order by reading split points from an externally generated source.
TracingHeaderFormat
TracingHeaderVersion
Enum representing the version of the tracing header used in Azure Blob File System (ABFS).
TransferFsImage.TransferResult
Trash
Provides a trash facility which supports pluggable Trash policies.
TrashPolicy
This interface is used for implementing different Trash policies.
TreePath
Traversal cursor in external filesystem.
TreeWalk
Traversal yielding a hierarchical sequence of paths.
Trilean
Enum to represent 3 values, TRUE, FALSE and UNKNOWN.
TrileanConversionException
Thrown when tried to convert Trilean.UNKNOWN to boolean.
Tristate
Simple enum to express {true, false, don't know}.
TupleWritable
Writable type storing multiple `Writable`s.
TupleWritable
Writable type storing multiple `Writable`s.
TwoDArrayWritable
A Writable for 2D arrays containing a matrix of instances of a class.
Type
The possible type codes.
UGIResolver
Pluggable class for mapping ownership and permissions from an external store to an FSImage.
UniqValueCount
This class implements a value aggregator that dedupes a sequence of objects.
UniqValueCount
This class implements a value aggregator that dedupes a sequence of objects.
UnknownCipherSuiteException
Thrown when an unknown cipher suite is encountered.
UnknownCryptoProtocolVersionException
UnknownStoreException
The bucket or other AWS resource is unknown.
UnsupportedFileSystemException
File system for a given file system name/scheme is not supported
UnsupportedMultipartUploaderException
MultipartUploader for a given file system name/scheme is not supported.
UpdateApplicationPriorityRequest
The request sent by the client to the `ResourceManager` to set or update the application priority.
UpdateApplicationPriorityResponse
The response sent by the `ResourceManager` to the client on update the application priority.
UpdateApplicationTimeoutsRequest
The request sent by the client to the `ResourceManager` to set or update the application timeout.
UpdateApplicationTimeoutsResponse
The response sent by the `ResourceManager` to the client on update application timeout.
UpdateContainerError
`UpdateContainerError` is used by the Scheduler to notify the ApplicationMaster of an UpdateContainerRequest it cannot satisfy due to an error in the request.
UpdateContainerRequest
`UpdateContainerRequest` represents the request made by an application to the `ResourceManager` to update an attribute of a `Container` such as its Resource allocation or (@code ExecutionType}
UpdatedContainer
An object that encapsulates an updated container and the type of Update.
UploadHandle
Opaque, serializable reference to an uploadId for multipart uploads.
URL
`URL` represents a serializable `URL`.
UserDefinedValueAggregatorDescriptor
This class implements a wrapper for a user defined value aggregator descriptor.
UserDefinedValueAggregatorDescriptor
This class implements a wrapper for a user defined value aggregator descriptor.
UserEntity
This entity represents a user.
UserGroupInformation
User and group information for Hadoop.
UserGroupInformation.AuthenticationMethod
existing types of authentications' methods
UseSharedCacheResourceRequest
The request from clients to the `SharedCacheManager` that claims a resource in the shared cache.
UseSharedCacheResourceResponse
The response from the SharedCacheManager to the client that indicates whether a requested resource exists in the cache.
UTCClock
Implementation of `Clock` that gives the current UTC time in milliseconds.
Utils
Supporting Utility classes used by TFile, and shared by users of TFile.
Utils
A utility class.
Utils
Deprecated.
Replaced by Avro.
ValidateVolumeCapabilitiesRequest.AccessMode
Volume access mode.
ValidateVolumeCapabilitiesRequest.VolumeType
Volume type.
ValueAggregator<E>
This interface defines the minimal protocol for value aggregators.
ValueAggregator<E>
This interface defines the minimal protocol for value aggregators.
ValueAggregatorBaseDescriptor
This class implements the common functionalities of the subclasses of ValueAggregatorDescriptor class.
ValueAggregatorBaseDescriptor
This class implements the common functionalities of the subclasses of ValueAggregatorDescriptor class.
ValueAggregatorCombiner<K1 extends WritableComparable,V1 extends Writable>
This class implements the generic combiner of Aggregate.
ValueAggregatorCombiner<K1 extends WritableComparable<?>,V1 extends Writable>
This class implements the generic combiner of Aggregate.
ValueAggregatorDescriptor
This interface defines the contract a value aggregator descriptor must support.
ValueAggregatorDescriptor
This interface defines the contract a value aggregator descriptor must support.
ValueAggregatorJob
This is the main class for creating a map/reduce job using Aggregate framework.
ValueAggregatorJob
This is the main class for creating a map/reduce job using Aggregate framework.
ValueAggregatorJobBase<K1 extends WritableComparable,V1 extends Writable>
This abstract class implements some common functionalities of the the generic mapper, reducer and combiner classes of Aggregate.
ValueAggregatorJobBase<K1 extends WritableComparable<?>,V1 extends Writable>
This abstract class implements some common functionalities of the the generic mapper, reducer and combiner classes of Aggregate.
ValueAggregatorMapper<K1 extends WritableComparable,V1 extends Writable>
This class implements the generic mapper of Aggregate.
ValueAggregatorMapper<K1 extends WritableComparable<?>,V1 extends Writable>
This class implements the generic mapper of Aggregate.
ValueAggregatorReducer<K1 extends WritableComparable,V1 extends Writable>
This class implements the generic reducer of Aggregate.
ValueAggregatorReducer<K1 extends WritableComparable<?>,V1 extends Writable>
This class implements the generic reducer of Aggregate.
ValueHistogram
This class implements a value aggregator that computes the histogram of a sequence of strings.
ValueHistogram
This class implements a value aggregator that computes the histogram of a sequence of strings.
ValueQueue.SyncGenerationPolicy
Policy to decide how many values to return to client when client asks for "n" values and Queue is empty.
VersionedWritable
A base class for Writables that provides version checking.
VersionInfo
This class returns build information about Hadoop components.
VersionMismatchException
Thrown by `VersionedWritable.readFields(DataInput)` when the version of an object being read does not match the current implementation version as returned by `VersionedWritable.getVersion()`.
ViewFileSystem
ViewFileSystem (extends the FileSystem interface) implements a client-side mount table.
ViewFileSystemUtil
Utility APIs for ViewFileSystem.
ViewFs
ViewFs (extends the AbstractFileSystem interface) implements a client-side mount table.
VIntWritable
A WritableComparable for integer values stored in variable-length format.
VLongWritable
A WritableComparable for longs in a variable-length format.
WebApp.HTTP
WebHdfs
AbstractFileSystem implementation for HDFS over the web.
WrappedIO
Reflection-friendly access to APIs which are not available in some of the older Hadoop versions which libraries still compile against.
WrappedMapper<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
A `Mapper` which wraps a given one to allow custom `Mapper.Context` implementations.
WrappedRecordReader<K extends WritableComparable,U extends Writable>
Proxy class for a RecordReader participating in the join framework.
WrappedRecordReader<K extends WritableComparable<?>,U extends Writable>
Proxy class for a RecordReader participating in the join framework.
WrappedReducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
A `Reducer` which wraps a given one to allow for custom `Reducer.Context` implementations.
WrappedStatistics
Reflection-friendly access to IOStatistics APIs.
Writable
A serializable object which implements a simple, efficient, serialization protocol, based on `DataInput` and `DataOutput`.
WritableComparable<T>
A `Writable` which is also `Comparable`.
WritableComparator
A Comparator for `WritableComparable`s.
WritableFactories
Factories for non-public writables.
WritableFactory
A factory for a class of Writable.
WritableSerialization
A `Serialization` for `Writable`s that delegates to `Writable.write(java.io.DataOutput)` and `Writable.readFields(java.io.DataInput)`.
WritableUtils
WriteObjectFlags
Flags to use when creating/writing objects.
XAttr.NameSpace
XAttrCodec
The value of `XAttr` is byte[], this class is to covert byte[] to some kind of string representation or convert back.
XAttrFormat
Class to pack XAttrs into byte[].
Note: this format is used both in-memory and on-disk.
XAttrProtos.XAttrProto.XAttrNamespaceProto
Protobuf enum `hadoop.hdfs.XAttrProto.XAttrNamespaceProto`
XAttrProtos.XAttrSetFlagProto
Protobuf enum `hadoop.hdfs.XAttrSetFlagProto`
XAttrSetFlag
XDR.State
XFrameOptionsFilter
This filter protects webapps from clickjacking attacks that are possible through use of Frames to embed the resources in another application and intercept clicks to accomplish nefarious things.
YarnApplicationAttemptState
Enumeration of various states of a `RMAppAttempt`.
YarnApplicationState
Enumeration of various states of an `ApplicationMaster`.
YarnClient
YarnClientApplication
YarnClusterMetrics
`YarnClusterMetrics` represents cluster metrics.
YarnConfiguration
YarnException
YarnException indicates exceptions from yarn servers.
YARNFeatureNotEnabledException
This exception is thrown when a feature is being used which is not enabled yet.
YarnServerFederationProtos.SubClusterStateProto
Protobuf enum `hadoop.yarn.SubClusterStateProto`
YarnUncaughtExceptionHandler
This class is intended to be installed by calling `Thread.setDefaultUncaughtExceptionHandler(UncaughtExceptionHandler)` In the main entry point.
ZKFCProtocolPB
ZlibCompressor.CompressionHeader
The type of header for compressed data.
ZlibCompressor.CompressionLevel
The compression level for zlib library.
ZlibCompressor.CompressionStrategy
The compression level for zlib library.
ZlibDecompressor.CompressionHeader
The headers to detect from compressed data.
ZoneReencryptionStatus.State
State of re-encryption.