Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 2.0.2-alpha - 2012-10-09

### INCOMPATIBLE CHANGES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-4072 | User set java.library.path seems to overwrite default creating problems native lib loading | Major | mrv2 | Anupam Seth | Anupam Seth
MAPREDUCE-3812 | Lower default allocation sizes, fix allocation configurations and document them | Major | mrv2, performance | Vinod Kumar Vavilapalli | Harsh J
HDFS-3318 | Hftp hangs on transfers >2GB | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp
HADOOP-8388 | Remove unused BlockLocation serialization | Minor | . | Colin P. McCabe | Colin P. McCabe
HADOOP-8368 | Use CMake rather than autotools to build native code | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-3522 | If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations | Major | namenode | Brandon Li | Brandon Li
HADOOP-8458 | Add management hook to AuthenticationHandler to enable delegation token operations support | Major | security | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4311 | Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings | Major | capacity-sched, mrv2 | Thomas Graves | Karthik Kambatla
HDFS-3446 | HostsFileReader silently ignores bad includes/excludes | Major | namenode | Matthew Jacobs | Matthew Jacobs
HDFS-3675 | libhdfs: follow documented return codes | Minor | libhdfs | Colin P. McCabe | Colin P. McCabe
HDFS-2617 | Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution | Major | security | Jakob Homan | Jakob Homan
HADOOP-8551 | fs -mkdir creates parent directories without the -p option | Major | fs | Robert Joseph Evans | John George
HADOOP-8689 | Make trash a server side configuration option | Major | fs | Eli Collins | Eli Collins
HADOOP-8710 | Remove ability for users to easily run the trash emptier | Major | fs | Eli Collins | Eli Collins
HDFS-2727 | libhdfs should get the default block size from the server | Minor | libhdfs | Sho Shimauchi | Colin P. McCabe
HDFS-2686 | Remove DistributedUpgrade related code | Major | datanode, namenode | Todd Lipcon | Suresh Srinivas
MAPREDUCE-4629 | Remove JobHistory.DEBUG_MODE | Major | . | Karthik Kambatla | Karthik Kambatla
HADOOP-8794 | Modifiy bin/hadoop to point to HADOOP_YARN_HOME | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-2978 | The NameNode should expose name dir statuses via JMX | Major | namenode | Aaron T. Myers | Aaron T. Myers
HADOOP-8135 | Add ByteBufferReadable interface to FSDataInputStream | Major | fs | Henry Robinson | Henry Robinson
MAPREDUCE-3773 | Add queue metrics with buckets for job run times | Major | jobtracker | Owen O’Malley | Owen O’Malley
HDFS-744 | Support hsync in HDFS | Major | datanode, hdfs-client | Hairong Kuang | Lars Hofhansl
HDFS-3042 | Automatic failover support for NN HA | Major | auto-failover, ha | Todd Lipcon | Todd Lipcon
HADOOP-8465 | hadoop-auth should support ephemeral authentication | Major | security | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3535 | Audit logging should log denied accesses | Major | namenode | Andy Isaacson | Andy Isaacson
MAPREDUCE-4355 | Add RunningJob.getJobStatus() | Major | mrv1, mrv2 | Karthik Kambatla | Karthik Kambatla
MAPREDUCE-3451 | Port Fair Scheduler to MR2 | Major | mrv2, scheduler | NO NAME | NO NAME
MAPREDUCE-987 | Exposing MiniDFS and MiniMR clusters as a single process command-line | Minor | build, test | Philip Zeyliger | Ahmed Radwan
MAPREDUCE-4417 | add support for encrypted shuffle | Major | mrv2, security | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3113 | httpfs does not support delegation tokens | Major | . | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-8644 | AuthenticatedURL should be able to use SSLFactory | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3637 | Add support for encrypting the DataTransferProtocol | Major | datanode, hdfs-client, security | Aaron T. Myers | Aaron T. Myers
HADOOP-8581 | add support for HTTPS to the web UIs | Major | security | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3150 | Add option for clients to contact DNs via hostname | Major | datanode, hdfs-client | Eli Collins | Eli Collins
HDFS-2793 | Add an admin command to trigger an edit log roll | Major | namenode | Aaron T. Myers | Todd Lipcon

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-2834 | ByteBuffer-based read API for DFSInputStream | Major | hdfs-client, performance | Henry Robinson | Henry Robinson
HADOOP-8242 | AbstractDelegationTokenIdentifier: add getter methods for owner and realuser | Minor | . | Colin P. McCabe | Colin P. McCabe
HADOOP-8244 | Improve comments on ByteBufferReadable.read | Major | . | Henry Robinson | Henry Robinson
HDFS-3110 | libhdfs implementation of direct read API | Major | libhdfs, performance | Henry Robinson | Henry Robinson
MAPREDUCE-4059 | The history server should have a separate pluggable storage/query interface | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-4017 | Add jobname to jobsummary log | Trivial | jobhistoryserver, jobtracker | Koji Noguchi | Thomas Graves
HADOOP-7510 | Tokens should use original hostname provided instead of ip | Major | security | Daryn Sharp | Daryn Sharp
HADOOP-8286 | Simplify getting a socket address from conf | Major | conf | Daryn Sharp | Daryn Sharp
MAPREDUCE-4151 | RM scheduler web page should filter apps to those that are relevant to scheduling | Major | mrv2, webapps | Jason Lowe | Jason Lowe
HDFS-2652 | Port token service changes from 205 | Major | . | Daryn Sharp | Daryn Sharp
MAPREDUCE-4190 | Improve web UI for task attempts userlog link | Major | mrv2, webapps | Thomas Graves | Thomas Graves
MAPREDUCE-4079 | Allow MR AppMaster to limit ephemeral port range. | Blocker | mr-am, mrv2 | Robert Joseph Evans | Robert Joseph Evans
HADOOP-8227 | Allow RPC to limit ephemeral port range. | Blocker | . | Robert Joseph Evans | Robert Joseph Evans
HADOOP-8335 | Improve Configuration’s address handling | Major | util | Daryn Sharp | Daryn Sharp
MAPREDUCE-4210 | Expose listener address for WebApp | Major | webapps | Daryn Sharp | Daryn Sharp
MAPREDUCE-4205 | retrofit all JVM shutdown hooks to use ShutdownHookManager | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-3850 | Avoid redundant calls for tokens in TokenCache | Major | security | Daryn Sharp | Daryn Sharp
HADOOP-8373 | Port RPC.getServerAddress to 0.23 | Major | ipc | Daryn Sharp | Daryn Sharp
HDFS-3390 | DFSAdmin should print full stack traces of errors when DEBUG logging is enabled | Minor | hdfs-client | Aaron T. Myers | Aaron T. Myers
HDFS-3341 | Change minimum RPC versions to 2.0.0-SNAPSHOT instead of 2.0.0 | Minor | . | Todd Lipcon | Todd Lipcon
HADOOP-8340 | SNAPSHOT build versions should compare as less than their eventual final release | Minor | util | Todd Lipcon | Todd Lipcon
MAPREDUCE-3659 | Host-based token support | Major | security | Daryn Sharp | Daryn Sharp
HDFS-3230 | Cleanup DatanodeID creation in the tests | Minor | test | Eli Collins | Eli Collins
HDFS-3401 | Cleanup DatanodeDescriptor creation in the tests | Major | datanode, test | Eli Collins | Eli Collins
HDFS-3400 | DNs should be able start with jsvc even if security is disabled | Major | datanode, scripts | Aaron T. Myers | Aaron T. Myers
HADOOP-8224 | Don’t hardcode hdfs.audit.logger in the scripts | Major | conf | Eli Collins | Tomohiko Kinebuchi
HDFS-3134 | Harden edit log loader against malformed or malicious input | Major | namenode | Colin P. McCabe | Colin P. McCabe
HADOOP-8361 | Avoid out-of-memory problems when deserializing strings | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-3404 | Make putImage in GetImageServlet infer remote address to fetch from request | Major | . | Aaron T. Myers | Aaron T. Myers
HDFS-3335 | check for edit log corruption at the end of the log | Major | . | Colin P. McCabe | Colin P. McCabe
HDFS-3416 | Cleanup DatanodeID and DatanodeRegistration constructors used by testing | Minor | datanode | Eli Collins | Eli Collins
HDFS-3417 | Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode | Minor | datanode | Eli Collins | Eli Collins
HDFS-3419 | Cleanup LocatedBlock | Minor | . | Eli Collins | Eli Collins
HADOOP-8398 | Cleanup BlockLocation | Minor | . | Eli Collins | Eli Collins
HDFS-3438 | BootstrapStandby should not require a rollEdits on active node | Major | ha | Todd Lipcon | Todd Lipcon
HDFS-2885 | Remove “federation” from the nameservice config options | Major | namenode | Eli Collins | Tsz Wo Nicholas Sze
HDFS-3394 | Do not use generic in INodeFile.getLastBlock() | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-4274 | MapOutputBuffer should use native byte order for kvmeta | Minor | performance, task | Todd Lipcon | Todd Lipcon
HDFS-3454 | Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled | Minor | balancer & mover | Eli Collins | Eli Collins
HADOOP-8367 | Improve documentation of declaringClassProtocolName in rpc headers | Major | . | Sanjay Radia | Sanjay Radia
HDFS-1013 | Miscellaneous improvements to HTML markup for web UIs | Minor | . | Todd Lipcon | Eugene Koontz
HADOOP-8323 | Revert HADOOP-7940 and improve javadocs and test for Text.clear() | Critical | io | Harsh J | Harsh J
HDFS-2391 | Newly set BalancerBandwidth value is not displayed anywhere | Major | balancer & mover | Rajit Saha | Harsh J
HADOOP-8358 | Config-related WARN for dfs.web.ugi can be avoided. | Trivial | conf | Harsh J | Harsh J
MAPREDUCE-4146 | Support limits on task status string length and number of block locations in branch-2 | Major | . | Tom White | Ahmed Radwan
MAPREDUCE-4301 | Dedupe some strings in MRAM for memory savings | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans
HDFS-3040 | TestMulitipleNNDataBlockScanner is misspelled | Trivial | test | Aaron T. Myers | madhukara phatak
MAPREDUCE-3842 | stop webpages from automatic refreshing | Critical | mrv2, webapps | Alejandro Abdelnur | Thomas Graves
HDFS-3514 | Add missing TestParallelLocalRead | Major | test | Henry Robinson | Henry Robinson
MAPREDUCE-3871 | Allow symlinking in LocalJobRunner DistributedCache | Major | distributed-cache | Tom White | Tom White
MAPREDUCE-3921 | MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy | Major | mr-am, mrv2 | Vinod Kumar Vavilapalli | Bikas Saha
HDFS-3520 | Add transfer rate logging to TransferFsImage | Minor | namenode | Eli Collins | Eli Collins
HDFS-3504 | Configurable retry in DFSClient | Major | hdfs-client | Siddharth Seth | Tsz Wo Nicholas Sze
HDFS-3372 | offlineEditsViewer should be able to read a binary edits file with recovery mode | Minor | tools | Colin P. McCabe | Colin P. McCabe
HADOOP-8524 | Allow users to get source of a Configuration parameter | Trivial | conf | Harsh J | Harsh J
HDFS-3516 | Check content-type in WebHdfsFileSystem | Major | hdfs-client, webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-3481 | Refactor HttpFS handling of JAX-RS query string parameters | Major | . | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3002 | TestNameNodeMetrics need not wait for metrics update with new metrics framework | Trivial | test | Suresh Srinivas | Suresh Srinivas
HADOOP-8535 | Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1) | Major | build | Jonathan Eagles | Jonathan Eagles
HDFS-3475 | Make the replication and invalidation rates configurable | Trivial | . | Harsh J | Harsh J
HADOOP-6802 | Remove FS_CLIENT_BUFFER_DIR_KEY = “fs.client.buffer.dir” from CommonConfigurationKeys.java (not used, deprecated) | Major | conf, fs | Erik Steffl | Sho Shimauchi
HADOOP-3450 | Add tests to Local Directory Allocator for asserting their URI-returning capability | Minor | fs | Ari Rabkin | Sho Shimauchi
HADOOP-8533 | Remove Parallel Call in IPC | Major | ipc | Suresh Srinivas | Brandon Li
HADOOP-8463 | hadoop.security.auth_to_local needs a key definition and doc | Major | security | Eli Collins | madhukara phatak
HDFS-3343 | Improve metrics for DN read latency | Major | datanode | Todd Lipcon | Andrew Wang
HDFS-3170 | Add more useful metrics for write latency | Major | datanode | Todd Lipcon | Matthew Jacobs
HDFS-3604 | Add dfs.webhdfs.enabled to hdfs-default.xml | Minor | . | Eli Collins | Eli Collins
HDFS-2988 | Improve error message when storage directory lock fails | Minor | namenode | Todd Lipcon | Miomir Boljanovic
MAPREDUCE-3907 | Document entries mapred-default.xml for the jobhistory server. | Minor | documentation | Eugene Koontz | Eugene Koontz
MAPREDUCE-3906 | Fix inconsistency in documentation regarding mapreduce.jobhistory.principal | Trivial | documentation | Eugene Koontz | Eugene Koontz
HADOOP-8525 | Provide Improved Traceability for Configuration | Trivial | . | Robert Joseph Evans | Robert Joseph Evans
HDFS-3613 | GSet prints some INFO level values, which aren’t really very useful to all | Trivial | namenode | Harsh J | Andrew Wang
HDFS-3582 | Hook daemon process exit for testing | Minor | test | Eli Collins | Eli Collins
HADOOP-8541 | Better high-percentile latency metrics | Major | metrics | Andrew Wang | Andrew Wang
HDFS-3641 | Move server Util time methods to common and use now instead of System#currentTimeMillis | Minor | . | Eli Collins | Eli Collins
HDFS-3612 | Single namenode image directory config warning can be improved | Trivial | namenode | Harsh J | Andy Isaacson
HDFS-3568 | fuse_dfs: add support for security | Major | . | Colin P. McCabe | Colin P. McCabe
HDFS-799 | libhdfs must call DetachCurrentThread when a thread is destroyed | Major | . | Christian Kunz | Colin P. McCabe
HDFS-3610 | fuse_dfs: Provide a way to use the default (configured) NN URI | Minor | . | Colin P. McCabe | Colin P. McCabe
HADOOP-8362 | Improve exception message when Configuration.set() is called with a null key or value | Trivial | conf | Todd Lipcon | madhukara phatak
HDFS-3663 | MiniDFSCluster should capture the code path that led to the first ExitException | Major | test | Eli Collins | Eli Collins
YARN-420 | Enable the RM to work with AM’s that are not managed by it | Major | applications/unmanaged-AM-launcher | Bikas Saha | Bikas Saha
HDFS-3659 | Add missing @Override to methods across the hadoop-hdfs project | Minor | documentation | Brandon Li | Brandon Li
HADOOP-8531 | SequenceFile Writer can throw out a better error if a serializer or deserializer isn’t available | Trivial | io | Harsh J | madhukara phatak
HDFS-3537 | Move libhdfs and fuse-dfs source to native subdirectories | Minor | fuse-dfs, libhdfs | Colin P. McCabe | Colin P. McCabe
HDFS-3666 | Plumb more exception messages to terminate | Minor | . | Eli Collins | Eli Collins
MAPREDUCE-4283 | Display tail of aggregated logs by default | Major | jobhistoryserver, mrv2 | Jason Lowe | Jason Lowe
MAPREDUCE-4422 | YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration | Major | nodemanager | Arun C Murthy | Ahmed Radwan
MAPREDUCE-4157 | ResourceManager should not kill apps that are well behaved | Major | mrv2 | Jason Lowe | Jason Lowe
HDFS-3583 | Convert remaining tests to Junit4 | Major | test | Eli Collins | Andrew Wang
HADOOP-8609 | IPC server logs a useless message when shutting down socket | Major | . | Todd Lipcon | Jon Zuanich
HDFS-3711 | Manually convert remaining tests to JUnit4 | Major | . | Andrew Wang | Andrew Wang
YARN-419 | Add client side for Unmanaged-AMs | Major | applications/unmanaged-AM-launcher | Bikas Saha | Bikas Saha
HADOOP-8623 | hadoop jar command should respect HADOOP_OPTS | Minor | scripts | Steven Willis | Steven Willis
HDFS-3650 | Use MutableQuantiles to provide latency histograms for various operations | Major | . | Andrew Wang | Andrew Wang
HADOOP-8635 | Cannot cancel paths registered deleteOnExit | Critical | fs | Daryn Sharp | Daryn Sharp
MAPREDUCE-4375 | Show Configuration Tracability in MR UI | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans
HADOOP-8620 | Add -Drequire.fuse and -Drequire.snappy | Minor | build | Colin P. McCabe | Colin P. McCabe
HDFS-3513 | HttpFS should cache filesystems | Major | . | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3697 | Enable fadvise readahead by default | Minor | datanode, performance | Todd Lipcon | Todd Lipcon
MAPREDUCE-3289 | Make use of fadvise in the NM’s shuffle handler | Major | mrv2, nodemanager, performance | Todd Lipcon | Todd Lipcon
HDFS-3276 | initializeSharedEdits should have a -nonInteractive flag | Minor | ha, namenode | Vinithra Varadharajan | Todd Lipcon
HADOOP-8687 | Upgrade log4j to 1.2.17 | Minor | . | Eli Collins | Eli Collins
HDFS-3765 | Namenode INITIALIZESHAREDEDITS should be able to initialize all shared storages | Major | ha | Vinayakumar B | Vinayakumar B
HDFS-3723 | All commands should support meaningful –help | Major | scripts, tools | E. Sammer | Jing Zhao
HDFS-3802 | StartupOption.name in HdfsServerConstants should be final | Trivial | . | Jing Zhao | Jing Zhao
HDFS-3796 | Speed up edit log tests by avoiding fsync() | Minor | test | Todd Lipcon | Todd Lipcon
HADOOP-8278 | Make sure components declare correct set of dependencies | Major | build | Tom White | Tom White
MAPREDUCE-4511 | Add IFile readahead | Major | mrv1, mrv2, performance | Ahmed Radwan | Ahmed Radwan
HADOOP-8700 | Move the checksum type constants to an enum | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-2421 | Improve the concurrency of SerialNumberMap in NameNode | Major | namenode | Hairong Kuang | Jing Zhao
HDFS-3672 | Expose disk-location information for blocks to enable better scheduling | Major | . | Andrew Wang | Andrew Wang
HADOOP-8240 | Allow users to specify a checksum type on create() | Major | fs | Kihwal Lee | Kihwal Lee
HADOOP-8239 | Extend MD5MD5CRC32FileChecksum to show the actual checksum type being used | Major | fs | Kihwal Lee | Kihwal Lee
HDFS-3819 | Should check whether invalidate work percentage default value is not greater than 1.0f | Minor | . | Jing Zhao | Jing Zhao
HADOOP-8075 | Lower native-hadoop library log from info to debug | Major | native | Eli Collins | Hızır Sefa İrken
MAPREDUCE-4408 | allow jobs to set a JAR that is in the distributed cached | Major | mrv1, mrv2 | Alejandro Abdelnur | Robert Kanter
HDFS-3844 | Add @Override where necessary and remove unnecessary {@inheritdoc} and imports | Trivial | . | Jing Zhao | Jing Zhao
HADOOP-8748 | Move dfsclient retry to a util class | Minor | io | Arun C Murthy | Arun C Murthy
MAPREDUCE-4614 | Simplify debugging a job’s tokens | Major | client, task | Daryn Sharp | Daryn Sharp
HDFS-3871 | Change NameNodeProxies to use HADOOP-8748 | Minor | hdfs-client | Arun C Murthy | Arun C Murthy
MAPREDUCE-2786 | TestDFSIO should also test compression reading/writing from command-line. | Minor | benchmarks | Plamen Jeliazkov | Plamen Jeliazkov
YARN-10 | dist-shell shouldn’t have a (test) dependency on hadoop-mapreduce-client-core | Major | . | Arun C Murthy | Hitesh Shah
HDFS-3866 | HttpFS POM should have property where to download tomcat from | Minor | build | Ryan Hennig | Plamen Jeliazkov
HDFS-3887 | Remove redundant chooseTarget methods in BlockPlacementPolicy.java | Trivial | namenode | Jing Zhao | Jing Zhao
HADOOP-8624 | ProtobufRpcEngine should log all RPCs if TRACE logging is enabled | Minor | ipc | Todd Lipcon | Todd Lipcon
HADOOP-8754 | Deprecate all the RPC.getServer() variants | Minor | ipc | Brandon Li | Brandon Li
MAPREDUCE-4638 | MR AppMaster shouldn’t rely on YARN_APPLICATION_CLASSPATH providing MR jars | Major | . | Arun C Murthy | Arun C Murthy
YARN-80 | Support delay scheduling for node locality in MR2’s capacity scheduler | Major | capacityscheduler | Todd Lipcon | Arun C Murthy
YARN-9 | Rename YARN_HOME to HADOOP_YARN_HOME | Major | . | Arun C Murthy | Vinod Kumar Vavilapalli
YARN-137 | Change the default scheduler to the CapacityScheduler | Major | scheduler | Siddharth Seth | Siddharth Seth
HDFS-3607 | log a message when fuse_dfs is not built | Minor | fuse-dfs | Colin P. McCabe | Colin P. McCabe
HDFS-3227 | Mavenise libhdfs tests | Major | libhdfs | Henry Robinson |
HDFS-3907 | Allow multiple users for local block readers | Major | datanode | Eli Collins | Eli Collins

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-7703 | WebAppContext should also be stopped and cleared | Major | . | Devaraj K | Devaraj K
HDFS-2285 | BackupNode should reject requests trying to modify namespace | Major | namenode | Konstantin Shvachko | Konstantin Shvachko
HDFS-2759 | Pre-allocate HDFS edit log files after writing version number | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers
HADOOP-8104 | Inconsistent Jackson versions | Major | . | Colin P. McCabe | Alejandro Abdelnur
MAPREDUCE-3728 | ShuffleHandler can’t access results when configured in a secure mode | Critical | mrv2, nodemanager | Roman Shaposhnik | Ding Yuan
HDFS-3037 | TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy | Minor | test | Aaron T. Myers | Aaron T. Myers
HDFS-2966 | TestNameNodeMetrics tests can fail under load | Minor | test | Steve Loughran | Steve Loughran
MAPREDUCE-3348 | mapred job -status fails to give info even if the job is present in History | Major | mrv2 | Devaraj K | Devaraj K
HADOOP-8167 | Configuration deprecation logic breaks backwards compatibility | Blocker | conf | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3067 | NPE in DFSInputStream.readBuffer if read is repeated on corrupted block | Major | hdfs-client | Henry Robinson | Henry Robinson
MAPREDUCE-4010 | TestWritableJobConf fails on trunk | Critical | mrv2 | Jason Lowe | Alejandro Abdelnur
HADOOP-8197 | Configuration logs WARNs on every use of a deprecated key | Critical | conf | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-3992 | Reduce fetcher doesn’t verify HTTP status code of response | Major | mrv1 | Todd Lipcon | Todd Lipcon
MAPREDUCE-4082 | hadoop-mapreduce-client-app’s mrapp-generated-classpath file should not be in the module JAR | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4091 | tools testcases failing because of MAPREDUCE-4082 | Critical | build, test | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4092 | commitJob Exception does not fail job (regression in 0.23 vs 0.20) | Blocker | mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-4089 | Hung Tasks never time out. | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-4024 | RM webservices can’t query on finalStatus | Major | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-4060 | Multiple SLF4J binding warning | Major | build | Jason Lowe | Jason Lowe
MAPREDUCE-4012 | Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used) | Minor | . | Koji Noguchi | Thomas Graves
MAPREDUCE-4062 | AM Launcher thread can hang forever | Major | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3988 | mapreduce.job.local.dir doesn’t point to a single directory on a node. | Major | mrv2 | Vinod Kumar Vavilapalli | Eric Payne
HDFS-3166 | Hftp connections do not have a timeout | Critical | hdfs-client | Daryn Sharp | Daryn Sharp
MAPREDUCE-3999 | Tracking link gives an error if the AppMaster hasn’t started yet | Major | mrv2, webapps | Ravi Prakash | Ravi Prakash
HDFS-3176 | JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. | Major | hdfs-client | Kihwal Lee | Kihwal Lee
MAPREDUCE-4020 | Web services returns incorrect JSON for deep queue tree | Major | mrv2, webapps | Jason Lowe | Anupam Seth
MAPREDUCE-3672 | Killed maps shouldn’t be counted towards JobCounter.NUM_FAILED_MAPS | Major | mr-am, mrv2 | Vinod Kumar Vavilapalli | Anupam Seth
MAPREDUCE-3682 | Tracker URL says AM tasks run on localhost | Major | mrv2 | David Capwell | Ravi Prakash
MAPREDUCE-3082 | archive command take wrong path for input file with current directory | Major | harchive | Rajit Saha | John George
MAPREDUCE-3650 | testGetTokensForHftpFS() fails | Blocker | mrv2 | Thomas Graves | Ravi Prakash
HADOOP-8088 | User-group mapping cache incorrectly does negative caching on transient failures | Major | security | Kihwal Lee | Kihwal Lee
HADOOP-8179 | risk of NPE in CopyCommands processArguments() | Minor | fs | Steve Loughran | Daryn Sharp
MAPREDUCE-4097 | tools testcases fail because missing mrapp-generated-classpath file in classpath | Major | build | Alejandro Abdelnur | Roman Shaposhnik
HADOOP-8180 | Remove hsqldb since its not needed from pom.xml | Major | . | Ravi Prakash | Ravi Prakash
HADOOP-6963 | Fix FileUtil.getDU. It should not include the size of the directory or follow symbolic links | Critical | fs | Owen O’Malley | Ravi Prakash
MAPREDUCE-3621 | TestDBJob and TestDataDrivenDBInputFormat ant tests fail | Major | mrv2 | Thomas Graves | Ravi Prakash
MAPREDUCE-4073 | CS assigns multiple off-switch containers when using multi-level-queues | Critical | mrv2, scheduler | Siddharth Seth | Siddharth Seth
HDFS-3136 | Multiple SLF4J binding warning | Major | build | Jason Lowe | Jason Lowe
HADOOP-8014 | ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary | Major | fs | Daryn Sharp | John George
MAPREDUCE-4117 | mapred job -status throws NullPointerException | Critical | client, mrv2 | Devaraj K | Devaraj K
HDFS-3235 | MiniDFSClusterManager doesn’t correctly support -format option | Minor | . | Henry Robinson | Henry Robinson
HDFS-3243 | TestParallelRead timing out on jenkins | Major | hdfs-client, test | Todd Lipcon | Henry Robinson
MAPREDUCE-4040 | History links should use hostname rather than IP address. | Minor | jobhistoryserver, mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh
MAPREDUCE-4099 | ApplicationMaster may fail to remove staging directory | Critical | mrv2 | Jason Lowe | Jason Lowe
MAPREDUCE-3932 | MR tasks failing and crashing the AM when available-resources/headRoom becomes zero | Critical | mr-am, mrv2 | Vinod Kumar Vavilapalli | Robert Joseph Evans
MAPREDUCE-4140 | mapreduce classes incorrectly importing “clover.org.apache.*” classes | Major | client, mrv2 | Patrick Hunt | Patrick Hunt
HADOOP-8144 | pseudoSortByDistance in NetworkTopology doesn’t work properly if no local node and first node is local rack node | Minor | io | Junping Du | Junping Du
MAPREDUCE-4050 | Invalid node link | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh
MAPREDUCE-4128 | AM Recovery expects all attempts of a completed task to also be completed. | Major | mrv2 | Bikas Saha | Bikas Saha
HADOOP-8005 | Multiple SLF4J binding message in .out file for all daemons | Major | scripts | Joe Crobak | Jason Lowe
MAPREDUCE-4144 | ResourceManager NPE while handling NODE_UPDATE | Critical | mrv2 | Jason Lowe | Jason Lowe
MAPREDUCE-4156 | ant build fails compiling JobInProgress | Major | build | Thomas Graves | Thomas Graves
MAPREDUCE-4160 | some mrv1 ant tests fail with timeout - due to 4156 | Major | test | Thomas Graves | Thomas Graves
MAPREDUCE-4139 | Potential ResourceManager deadlock when SchedulerEventDispatcher is stopped | Major | mrv2 | Jason Lowe | Jason Lowe
MAPREDUCE-4074 | Client continuously retries to RM When RM goes down before launching Application Master | Major | . | Devaraj K | xieguiming
HADOOP-8288 | Remove references of mapred.child.ulimit etc. since they are not being used any more | Major | . | Ravi Prakash | Ravi Prakash
MAPREDUCE-4159 | Job is running in Uber mode after setting “mapreduce.job.ubertask.maxreduces” to zero | Major | mrv2 | Nishan Shetty | Devaraj K
MAPREDUCE-4165 | Committing is misspelled as commiting in task logs | Trivial | mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-4129 | Lots of unneeded counters log messages | Major | mrv2 | Ahmed Radwan | Ahmed Radwan
MAPREDUCE-3947 | yarn.app.mapreduce.am.resource.mb not documented | Minor | . | Todd Lipcon | Devaraj K
HDFS-3308 | hftp/webhdfs can’t get tokens if authority has no port | Critical | webhdfs | Daryn Sharp | Daryn Sharp
MAPREDUCE-4133 | MR over viewfs is broken | Major | . | John George | John George
HDFS-3312 | Hftp selects wrong token service | Blocker | hdfs-client | Daryn Sharp | Daryn Sharp
HDFS-3321 | Error message for insufficient data nodes to come out of safemode is wrong. | Major | . | Ravi Prakash | Ravi Prakash
MAPREDUCE-4194 | ConcurrentModificationError in DirectoryCollection | Major | mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-4169 | Container Logs appear in unsorted order | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-4189 | TestContainerManagerSecurity is failing | Critical | mrv2 | Devaraj K | Devaraj K
HADOOP-8305 | distcp over viewfs is broken | Major | viewfs | John George | John George
HDFS-3334 | ByteRangeInputStream leaks streams | Major | hdfs-client | Daryn Sharp | Daryn Sharp
HDFS-3331 | setBalancerBandwidth do not checkSuperuserPrivilege | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-4209 | junit dependency in hadoop-mapreduce-client is missing scope test | Major | build | Radim Kolar |
MAPREDUCE-4206 | Sorting by Last Health-Update on the RM nodes page sorts does not work correctly | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles
HADOOP-8334 | HttpServer sometimes returns incorrect port | Major | . | Daryn Sharp | Daryn Sharp
HADOOP-8325 | Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook | Critical | fs | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-8330 | TestSequenceFile.testCreateUsesFsArg() is broken | Minor | test | John George | John George
HDFS-3275 | Format command overwrites contents of non-empty shared edits dir if name dirs are empty without any prompting | Major | ha, namenode | Vinithra Varadharajan | amith
MAPREDUCE-4211 | Error conditions (missing appid, appid not found) are masked in the RM app page | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles
HADOOP-8317 | Update maven-assembly-plugin to 2.3 - fix build on FreeBSD | Major | build | Radim Kolar |
HADOOP-8172 | Configuration no longer sets all keys in a deprecated key list. | Critical | conf | Robert Joseph Evans | Anupam Seth
HADOOP-8342 | HDFS command fails with exception following merge of HADOOP-8325 | Major | fs | Randy Clayton | Alejandro Abdelnur
HDFS-3359 | DFSClient.close should close cached sockets | Critical | hdfs-client | Todd Lipcon | Todd Lipcon
MAPREDUCE-4048 | NullPointerException exception while accessing the Application Master UI | Major | mrv2 | Devaraj K | Devaraj K
HADOOP-8327 | distcpv2 and distcpv1 jars should not coexist | Major | . | Dave Thompson | Dave Thompson
HADOOP-8328 | Duplicate FileSystem Statistics object for ‘file’ scheme | Major | fs | Tom White | Tom White
MAPREDUCE-4220 | RM apps page starttime/endtime sorts are incorrect | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-4226 | ConcurrentModificationException in FileSystemCounterGroup | Major | mrv2 | Tom White | Tom White
HADOOP-8341 | Fix or filter findbugs issues in hadoop-tools | Major | . | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-4215 | RM app page shows 500 error on appid parse error | Major | mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-4237 | TestNodeStatusUpdater can fail if localhost has a domain associated with it | Major | . | Robert Joseph Evans | Robert Joseph Evans
HADOOP-8372 | normalizeHostName() in NetUtils is not working properly in resolving a hostname start with numeric character | Major | io, util | Junping Du | Junping Du
HDFS-3385 | ClassCastException when trying to append a file | Major | namenode | Brahma Reddy Battula | Tsz Wo Nicholas Sze
MAPREDUCE-4148 | MapReduce should not have a compile-time dependency on HDFS | Major | mrv2 | Tom White | Tom White
HADOOP-8316 | Audit logging should be disabled by default | Major | conf | Eli Collins | Eli Collins
MAPREDUCE-4233 | NPE can happen in RMNMNodeInfo. | Critical | . | Robert Joseph Evans | Robert Joseph Evans
HDFS-3414 | Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs | Minor | balancer & mover | Aaron T. Myers | Aaron T. Myers
HDFS-3031 | HA: Fix complete() and getAdditionalBlock() RPCs to be idempotent. | Major | ha | Stephen Chu | Todd Lipcon
MAPREDUCE-4238 | mavenize data_join | Critical | mrv2 | Thomas Graves | Thomas Graves
HADOOP-8393 | hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster | Major | scripts | Patrick Hunt | Patrick Hunt
MAPREDUCE-4250 | hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster | Major | nodemanager | Patrick Hunt | Patrick Hunt
MAPREDUCE-4102 | job counters not available in Jobhistory webui for killed jobs | Major | webapps | Thomas Graves | Bhallamudi Venkata Siva Kamesh
HDFS-3413 | TestFailureToReadEdits timing out | Critical | ha, test | Todd Lipcon | Aaron T. Myers
HADOOP-8400 | All commands warn “Kerberos krb5 configuration not found” when security is not enabled | Major | security | Eli Collins | Alejandro Abdelnur
HDFS-3422 | TestStandbyIsHot timeouts too aggressive | Minor | test | Todd Lipcon | Todd Lipcon
HADOOP-8406 | CompressionCodecFactory.CODEC_PROVIDERS iteration is thread-unsafe | Major | io | Todd Lipcon | Todd Lipcon
MAPREDUCE-4264 | Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true | Blocker | mrv2 | Thomas Graves | Thomas Graves
HDFS-3433 | GetImageServlet should allow administrative requestors when security is enabled | Major | namenode | Aaron T. Myers | Aaron T. Myers
MAPREDUCE-3543 | Mavenize Gridmix. | Critical | mrv2 | Mahadev konar | Thomas Graves
HDFS-1153 | dfsnodelist.jsp should handle invalid input parameters | Minor | datanode | Ravi Phulari | Ravi Phulari
HDFS-2800 | HA: TestStandbyCheckpoints.testCheckpointCancellation is racy | Major | ha, test | Aaron T. Myers | Todd Lipcon
HDFS-3391 | TestPipelinesFailover#testLeaseRecoveryAfterFailover is failing | Critical | . | Arun C Murthy | Todd Lipcon
HADOOP-8287 | etc/hadoop is missing hadoop-env.sh | Major | conf | Eli Collins | Eli Collins
MAPREDUCE-4197 | Include the hsqldb jar in the hadoop-mapreduce tar file | Major | . | Ravi Prakash | Ravi Prakash
HDFS-3440 | should more effectively limit stream memory consumption when reading corrupt edit logs | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-3444 | hdfs groups command doesn’t work with security enabled | Major | hdfs-client | Aaron T. Myers | Aaron T. Myers
HADOOP-8329 | Build fails with Java 7 | Major | build | Kumar Ravi | Eli Collins
MAPREDUCE-4002 | MultiFileWordCount job fails if the input path is not from default file system | Major | examples | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh
MAPREDUCE-4269 | documentation: Gridmix has javadoc warnings in StressJobFactory | Major | mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-3870 | Invalid App Metrics | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh
HADOOP-8408 | MR doesn’t work with a non-default ViewFS mount table and security enabled | Major | viewfs | Aaron T. Myers | Aaron T. Myers
HDFS-3415 | During NameNode starting up, it may pick wrong storage directory inspector when the layout versions of the storage directories are different | Major | namenode | Brahma Reddy Battula | Brandon Li
HDFS-3436 | adding new datanode to existing pipeline fails in case of Append/Recovery | Major | datanode | Brahma Reddy Battula | Vinayakumar B
MAPREDUCE-4262 | NM gives wrong log message saying “Connected to ResourceManager” before trying to connect | Minor | mrv2, nodemanager | Devaraj K | Devaraj K
HDFS-2982 | Startup performance suffers when there are many edit log segments | Critical | namenode | Todd Lipcon | Colin P. McCabe
MAPREDUCE-4276 | Allow setting yarn.nodemanager.delete.debug-delay-sec property to “-1” for easier container debugging. | Major | mrv2 | Ahmed Radwan | Ahmed Radwan
MAPREDUCE-4224 | TestFifoScheduler throws org.apache.hadoop.metrics2.MetricsException | Major | mrv2, scheduler, test | Devaraj K | Devaraj K
HDFS-3460 | HttpFS proxyuser validation with Kerberos ON uses full principal name | Critical | . | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-8422 | Deprecate FileSystem#getDefault* and getServerDefault methods that don’t take a Path argument | Minor | fs | Eli Collins | Eli Collins
HDFS-3368 | Missing blocks due to bad DataNodes coming up and down. | Major | namenode | Konstantin Shvachko | Konstantin Shvachko
HADOOP-8268 | A few pom.xml across Hadoop project may fail XML validation | Major | build | Radim Kolar | Radim Kolar
HADOOP-8444 | Fix the tests FSMainOperationsBaseTest.java and F ileContextMainOperationsBaseTest.java to avoid potential test failure | Major | fs, test | Mariappan Asokan | madhukara phatak
MAPREDUCE-3493 | Add the default mapreduce.shuffle.port property to mapred-default.xml | Minor | mrv2 | Ahmed Radwan |
HDFS-3398 | Client will not retry when primaryDN is down once it’s just got pipeline | Minor | hdfs-client | Brahma Reddy Battula | amith
MAPREDUCE-4152 | map task left hanging after AM dies trying to connect to RM | Major | mrv2 | Thomas Graves | Thomas Graves
HADOOP-8452 | DN logs backtrace when running under jsvc and /jmx is loaded | Minor | . | Andy Isaacson | Andy Isaacson
MAPREDUCE-4297 | Usersmap file in gridmix should not fail on empty lines | Major | contrib/gridmix | Ravi Prakash | Ravi Prakash
HDFS-3484 | hdfs fsck doesn’t work if NN HTTP address is set to 0.0.0.0 even if NN RPC address is configured | Minor | hdfs-client | Aaron T. Myers | Aaron T. Myers
HDFS-3486 | offlineimageviewer can’t read fsimage files that contain persistent delegation tokens | Minor | security, tools | Colin P. McCabe | Colin P. McCabe
HDFS-3487 | offlineimageviewer should give byte offset information when it encounters an exception | Minor | tools | Colin P. McCabe | Colin P. McCabe
HADOOP-8460 | Document proper setting of HADOOP_PID_DIR and HADOOP_SECURE_DN_PID_DIR | Major | documentation | Robert Joseph Evans | Robert Joseph Evans
HADOOP-8466 | hadoop-client POM incorrectly excludes avro | Major | build | Bruno Mahé | Bruno Mahé
MAPREDUCE-4302 | NM goes down if error encountered during log aggregation | Critical | nodemanager | Daryn Sharp | Daryn Sharp
HDFS-3442 | Incorrect count for Missing Replicas in FSCK report | Minor | . | suja s | Andrew Wang
MAPREDUCE-4307 | TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem | Major | mrv2 | Ahmed Radwan | Ahmed Radwan
HDFS-2025 | Go Back to File View link is not working in tail.jsp | Minor | datanode | sravankorumilli | Ashish Singhi
HADOOP-8450 | Remove src/test/system | Trivial | test | Colin P. McCabe | Eli Collins
MAPREDUCE-3350 | Per-app RM page should have the list of application-attempts like on the app JHS page | Critical | mrv2, webapps | Vinod Kumar Vavilapalli | Jonathan Eagles
HDFS-3501 | Checkpointing with security enabled will stop working after ticket lifetime expires | Major | ha, namenode | Aaron T. Myers | Aaron T. Myers
HADOOP-8481 | update BUILDING.txt to talk about cmake rather than autotools | Trivial | documentation | Colin P. McCabe | Colin P. McCabe
HDFS-3266 | DFSTestUtil#waitCorruptReplicas doesn’t sleep between checks | Minor | . | Aaron T. Myers | madhukara phatak
MAPREDUCE-4313 | TestTokenCache doesn’t compile due TokenCache.getDelegationToken compilation error | Blocker | build, test | Eli Collins | Robert Joseph Evans
MAPREDUCE-3873 | Nodemanager is not getting decommisioned if the absolute ip is given in exclude file. | Minor | mrv2, nodemanager | Nishan Shetty | xieguiming
HDFS-3505 | DirectoryScanner does not join all threads in shutdown | Minor | . | Colin P. McCabe | Colin P. McCabe
HADOOP-8485 | Don’t hardcode “Apache Hadoop 0.23” in the docs | Minor | documentation | Eli Collins | Eli Collins
HDFS-3485 | DataTransferThrottler will over-throttle when currentTimeMillis jumps | Minor | . | Andy Isaacson | Andy Isaacson
HADOOP-8488 | test-patch.sh gives +1 even if the native build fails. | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-2914 | HA: Standby should not enter safemode when resources are low | Major | ha, namenode | Hari Mankude | Vinayakumar B
HDFS-3490 | DN WebHDFS methods throw NPE if Namenode RPC address param not specified | Minor | webhdfs | Todd Lipcon | Tsz Wo Nicholas Sze
MAPREDUCE-3927 | Shuffle hang when set map.failures.percent | Critical | mrv2 | MengWang | Bhallamudi Venkata Siva Kamesh
HDFS-2797 | Fix misuses of InputStream#skip in the edit log code | Major | ha, namenode | Aaron T. Myers | Colin P. McCabe
HDFS-3517 | TestStartup should bind ephemeral ports | Minor | test | Eli Collins | Eli Collins
HADOOP-8501 | Gridmix fails to compile on OpenJDK7u4 | Major | benchmarks | Radim Kolar | Radim Kolar
HDFS-3428 | move DelegationTokenRenewer to common | Major | security | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-8507 | Avoid OOM while deserializing DelegationTokenIdentifer | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-3531 | EditLogFileOutputStream#preallocate should check for incomplete writes | Minor | namenode | Colin P. McCabe | Colin P. McCabe
HDFS-766 | Error message not clear for set space quota out of boundary values. | Minor | . | Ravi Phulari | Jon Zuanich
HADOOP-8433 | Don’t set HADOOP_LOG_DIR in hadoop-env.sh | Major | scripts | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-3480 | Multiple SLF4J binding warning | Major | build | Eli Collins | Vinayakumar B
HADOOP-8509 | JarFinder duplicate entry: META-INF/MANIFEST.MF exception | Minor | util | Matteo Bertozzi | Alejandro Abdelnur
HDFS-3524 | TestFileLengthOnClusterRestart failed due to error message change | Major | test | Eli Collins | Brandon Li
HDFS-3518 | Provide API to check HDFS operational state | Major | hdfs-client | Bikas Saha | Tsz Wo Nicholas Sze
HADOOP-8495 | Update Netty to avoid leaking file descriptors during shuffle | Critical | build | Jason Lowe | Jason Lowe
HADOOP-8512 | AuthenticatedURL should reset the Token when the server returns other than OK on authentication | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4341 | add types to capacity scheduler properties documentation | Major | capacity-sched, mrv2 | Thomas Graves | Karthik Kambatla
MAPREDUCE-4267 | mavenize pipes | Critical | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-4270 | data_join test classes are in the wrong packge | Major | mrv2 | Brock Noland | Thomas Graves
MAPREDUCE-4306 | Problem running Distributed Shell applications as a user other than the one started the daemons | Major | mrv2 | Ahmed Radwan | Ahmed Radwan
MAPREDUCE-3889 | job client tries to use /tasklog interface, but that doesn’t exist anymore | Critical | mrv2 | Thomas Graves | Devaraj K
MAPREDUCE-4320 | gridmix mainClass wrong in pom.xml | Major | contrib/gridmix | Thomas Graves | Thomas Graves
MAPREDUCE-4295 | RM crashes due to DNS issue | Critical | mrv2, resourcemanager | Thomas Graves | Thomas Graves
MAPREDUCE-4031 | Node Manager hangs on shut down | Critical | mrv2, nodemanager | Devaraj K | Devaraj K
MAPREDUCE-4361 | Fix detailed metrics for protobuf-based RPC on 0.23 | Major | mrv2 | Jason Lowe | Jason Lowe
MAPREDUCE-4336 | Distributed Shell fails when used with the CapacityScheduler | Major | mrv2 | Siddharth Seth | Ahmed Radwan
MAPREDUCE-4290 | JobStatus.getState() API is giving ambiguous values | Major | mrv2 | Nishan Shetty | Devaraj K
HADOOP-7868 | Hadoop native fails to compile when default linker option is -Wl,–as-needed | Major | native | James Page | Trevor Robinson
MAPREDUCE-2289 | Permissions race can make getStagingDir fail on local filesystem | Major | job submission | Todd Lipcon | Ahmed Radwan
HADOOP-8129 | ViewFileSystemTestSetup setupForViewFileSystem is erring when the user’s home directory is somewhere other than /home (eg. /User) etc. | Major | fs, test | Ravi Prakash | Ahmed Radwan
MAPREDUCE-4228 | mapreduce.job.reduce.slowstart.completedmaps is not working properly to delay the scheduling of the reduce tasks | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe
MAPREDUCE-4372 | Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager | Major | mrv2, resourcemanager | Devaraj K | Devaraj K
HADOOP-8249 | invalid hadoop-auth cookies should trigger authentication if info is avail before returning HTTP 401 | Major | security | bc Wong | Alejandro Abdelnur
HDFS-3572 | Cleanup code which inits SPNEGO in HttpServer | Minor | namenode, security | Todd Lipcon | Todd Lipcon
HDFS-3551 | WebHDFS CREATE does not use client location for redirection | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-8168 | empty-string owners or groups causes {{MissingFormatWidthException}} in o.a.h.fs.shell.Ls.ProcessPath() | Major | fs | Eugene Koontz | Eugene Koontz
MAPREDUCE-4376 | TestClusterMRNotification times out | Major | mrv2, test | Jason Lowe | Kihwal Lee
HDFS-3559 | DFSTestUtil: use Builder class to construct DFSTestUtil instances | Minor | . | Colin P. McCabe | Colin P. McCabe
HADOOP-8438 | hadoop-validate-setup.sh refers to examples jar file which doesn’t exist | Major | . | Devaraj K | Devaraj K
MAPREDUCE-4383 | HadoopPipes.cc needs to include unistd.h | Minor | pipes | Andy Isaacson | Andy Isaacson
HDFS-3491 | HttpFs does not set permissions correctly | Major | . | Romain Rigaux | Alejandro Abdelnur
HDFS-3580 | incompatible types; no instance(s) of type variable(s) V exist so that V conforms to boolean compiling HttpFSServer.java with OpenJDK | Minor | . | Andy Isaacson | Andy Isaacson
HADOOP-8449 | hadoop fs -text fails with compressed sequence files with the codec file extension | Minor | . | Joey Echeverria | Harsh J
HADOOP-8538 | CMake builds fail on ARM | Major | native | Trevor Robinson | Trevor Robinson
HDFS-3157 | Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened | Major | namenode | J.Andreina | Ashish Singhi
HDFS-3575 | HttpFS does not log Exception Stacktraces | Minor | . | Brock Noland | Brock Noland
HADOOP-8110 | TestViewFsTrash occasionally fails | Major | fs | Tsz Wo Nicholas Sze | Jason Lowe
HDFS-3574 | Fix small race and do some cleanup in GetImageServlet | Minor | namenode | Todd Lipcon | Todd Lipcon
HADOOP-8547 | Package hadoop-pipes examples/bin directory (again) | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-3581 | FSPermissionChecker#checkPermission sticky bit check missing range check | Major | namenode | Eli Collins | Eli Collins
MAPREDUCE-4392 | Counters.makeCompactString() changed behavior from 0.20 | Major | mrv2 | Jason Lowe | Jason Lowe
HADOOP-8563 | don’t package hadoop-pipes examples/bin | Minor | build | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-4384 | Race conditions in IndexCache | Major | nodemanager | Kihwal Lee | Kihwal Lee
MAPREDUCE-4387 | RM gets fatal error and exits during TestRM | Major | resourcemanager | Kihwal Lee | Kihwal Lee
HDFS-2619 | Remove my personal email address from the libhdfs build file. | Major | build | Owen O’Malley | Owen O’Malley
HADOOP-8566 | AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays) | Major | io | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4379 | Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts | Blocker | mrv2, nodemanager | Devaraj K | Devaraj K
MAPREDUCE-2220 | Fix new API FileOutputFormat-related typos in mapred-default.xml | Minor | documentation | Rui KUBO | Rui KUBO
HDFS-3541 | Deadlock between recovery, xceiver and packet responder | Major | datanode | suja s | Vinayakumar B
HDFS-711 | hdfsUtime does not handle atime = 0 or mtime = 0 correctly | Major | documentation | freestyler | Colin P. McCabe
HDFS-3548 | NamenodeFsck.copyBlock fails to create a Block Reader | Critical | namenode | Todd Lipcon | Colin P. McCabe
HDFS-3591 | Backport HDFS-3357 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans
HDFS-3603 | Decouple TestHDFSTrash from TestTrash | Major | test | Jason Lowe | Jason Lowe
MAPREDUCE-4402 | TestFileInputFormat fails intermittently | Major | test | Jason Lowe | Jason Lowe
MAPREDUCE-2739 | MR-279: Update installation docs (remove YarnClientFactory) | Minor | mrv2 | Ahmed Radwan | Bo Wang
MAPREDUCE-3993 | Graceful handling of codec errors during decompression | Major | mrv1, mrv2 | Todd Lipcon | Karthik Kambatla
MAPREDUCE-4300 | OOM in AM can turn it into a zombie. | Major | applicationmaster | Robert Joseph Evans | Robert Joseph Evans
HDFS-3555 | idle client socket triggers DN ERROR log (should be INFO or DEBUG) | Major | datanode, hdfs-client | Jeff Lord | Andy Isaacson
MAPREDUCE-4252 | MR2 job never completes with 1 pending task | Major | mrv2 | Tom White | Tom White
HADOOP-8573 | Configuration tries to read from an inputstream resource multiple times. | Major | conf | Robert Joseph Evans | Robert Joseph Evans
HDFS-3629 | fix the typo in the error message about inconsistent storage layout version | Trivial | namenode | Brandon Li | Brandon Li
HDFS-3611 | NameNode prints unnecessary WARNs about edit log normally skipping a few bytes | Trivial | namenode | Harsh J | Colin P. McCabe
HADOOP-8586 | Fixup a bunch of SPNEGO misspellings | Major | . | Eli Collins | Eli Collins
HADOOP-3886 | Error in javadoc of Reporter, Mapper and Progressable | Minor | documentation | brien colwell | Jingguo Yao
HDFS-3615 | Two BlockTokenSecretManager findbugs warnings | Major | security | Eli Collins | Aaron T. Myers
HADOOP-8587 | HarFileSystem access of harMetaCache isn’t threadsafe | Minor | fs | Eli Collins | Eli Collins
HADOOP-8585 | Fix initialization circularity between UserGroupInformation and HadoopConfiguration | Minor | . | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-4416 | Some tests fail if Clover is enabled | Critical | client, mrv2 | Kihwal Lee | Kihwal Lee
HDFS-3633 | libhdfs: hdfsDelete should pass JNI_FALSE or JNI_TRUE | Minor | libhdfs | Colin P. McCabe | Colin P. McCabe
HDFS-3306 | fuse_dfs: don’t lock release operations | Minor | . | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-4432 | Confusing warning message when GenericOptionsParser is not used | Trivial | . | Gabriel Reid |
MAPREDUCE-4441 | Fix build issue caused by MR-3451 | Blocker | . | Karthik Kambatla | Karthik Kambatla
MAPREDUCE-4419 | ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename> | Major | mrv2 | Nishan Shetty | Devaraj K
MAPREDUCE-4299 | Terasort hangs with MR2 FifoScheduler | Major | mrv2 | Tom White | Tom White
HADOOP-8543 | Invalid pom.xml files on 0.23 branch | Major | build | Radim Kolar | Radim Kolar
HADOOP-8499 | Lower min.user.id to 500 for the tests | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-470 | libhdfs should handle 0-length reads from FSInputStream correctly | Minor | . | Pete Wyckoff | Colin P. McCabe
HDFS-3609 | libhdfs: don’t force the URI to look like hdfs://hostname:port | Major | libhdfs | Colin P. McCabe | Colin P. McCabe
HDFS-3539 | libhdfs code cleanups | Minor | . | Colin P. McCabe | Colin P. McCabe
HADOOP-7818 | DiskChecker#checkDir should fail if the directory is not executable | Minor | util | Eli Collins | madhukara phatak
MAPREDUCE-4395 | Possible NPE at ClientDistributedCacheManager#determineTimestamps | Critical | distributed-cache, job submission, mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh
HDFS-3622 | Backport HDFS-3541 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-4447 | Remove aop from cruft from the ant build | Major | build | Eli Collins | Eli Collins
MAPREDUCE-4437 | Race in MR ApplicationMaster can cause reducers to never be scheduled | Critical | applicationmaster, mrv2 | Jason Lowe | Jason Lowe
HADOOP-8423 | MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data | Major | io | Jason B | Todd Lipcon
HADOOP-8599 | Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file | Major | fs | Andrey Klochkov | Andrey Klochkov
MAPREDUCE-4440 | Change SchedulerApp & SchedulerNode to be a minimal interface | Major | . | Arun C Murthy | Arun C Murthy
MAPREDUCE-4449 | Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig | Major | mrv2 | Ahmed Radwan | Ahmed Radwan
MAPREDUCE-4380 | Empty Userlogs directory is getting created under logs directory | Minor | mrv2, nodemanager | Devaraj K | Devaraj K
MAPREDUCE-4448 | Nodemanager crashes upon application cleanup if aggregation failed to start | Critical | mrv2, nodemanager | Jason Lowe | Jason Lowe
HADOOP-8537 | Two TFile tests failing recently | Major | io | Todd Lipcon | Todd Lipcon
MAPREDUCE-4406 | Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan
MAPREDUCE-4407 | Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist package | Major | build, mrv2 | Ahmed Radwan | Ahmed Radwan
HDFS-3605 | Block mistakenly marked corrupt during edit log catchup phase of failover | Major | ha, namenode | Brahma Reddy Battula | Todd Lipcon
HDFS-3646 | LeaseRenewer can hold reference to inactive DFSClient instances forever | Critical | hdfs-client | Kihwal Lee | Kihwal Lee
HDFS-3673 | libhdfs: fix some compiler warnings | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-1249 | with fuse-dfs, chown which only has owner (or only group) argument fails with Input/output error. | Minor | fuse-dfs | matsusaka kentaro | Colin P. McCabe
HDFS-3690 | BlockPlacementPolicyDefault incorrectly casts LOG | Major | . | Eli Collins | Eli Collins
HDFS-3577 | WebHdfsFileSystem can not read files larger than 24KB | Blocker | webhdfs | Alejandro Abdelnur | Tsz Wo Nicholas Sze
HDFS-3597 | SNN can fail to start on upgrade | Minor | namenode | Andy Isaacson | Andy Isaacson
HDFS-3608 | fuse_dfs: detect changes in UID ticket cache | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-3688 | Namenode loses datanode hostname if datanode re-registers | Major | datanode | Jason Lowe | Jason Lowe
MAPREDUCE-3893 | allow capacity scheduler configs maximum-applications and maximum-am-resource-percent configurable on a per queue basis | Critical | mrv2 | Thomas Graves | Thomas Graves
HADOOP-8606 | FileSystem.get may return the wrong filesystem | Major | fs | Daryn Sharp | Daryn Sharp
MAPREDUCE-4467 | IndexCache failures due to missing synchronization | Critical | nodemanager | Andrey Klochkov | Kihwal Lee
MAPREDUCE-4465 | Update description of yarn.nodemanager.address property | Trivial | . | Bo Wang | Bo Wang
HDFS-3720 | hdfs.h must get packaged | Major | libhdfs | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-4423 | Potential infinite fetching of map output | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans
HDFS-3696 | Create files with WebHdfsFileSystem goes OOM when file size is big | Critical | webhdfs | Kihwal Lee | Tsz Wo Nicholas Sze
HADOOP-8626 | Typo in default setting for hadoop.security.group.mapping.ldap.search.filter.user | Major | security | Jonathan Natkins | Jonathan Natkins
HADOOP-8613 | AbstractDelegationTokenIdentifier#getUser() should set token auth type | Critical | . | Daryn Sharp | Daryn Sharp
HDFS-3679 | fuse_dfs notrash option sets usetrash | Minor | fuse-dfs | Conrad Meyer | Conrad Meyer
HADOOP-8627 | FS deleteOnExit may delete the wrong path | Critical | fs | Daryn Sharp | Daryn Sharp
HADOOP-8634 | Ensure FileSystem#close doesn’t squawk for deleteOnExit paths | Critical | fs | Daryn Sharp | Daryn Sharp
HDFS-3732 | fuse_dfs: incorrect configuration value checked for connection expiry timer period | Minor | fuse-dfs | Colin P. McCabe | Colin P. McCabe
HADOOP-8550 | hadoop fs -touchz automatically created parent directories | Major | fs | Robert Joseph Evans | John George
MAPREDUCE-4342 | Distributed Cache gives inconsistent result if cache files get deleted from task tracker | Major | . | Mayank Bansal | Mayank Bansal
MAPREDUCE-4456 | LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-4496 | AM logs link is missing user name | Major | applicationmaster, mrv2 | Jason Lowe | Jason Lowe
HADOOP-8637 | FilterFileSystem#setWriteChecksum is broken | Critical | fs | Daryn Sharp | Daryn Sharp
MAPREDUCE-4493 | Distibuted Cache Compatability Issues | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-4492 | Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull | Minor | mrv2 | Nishan Shetty | Mayank Bansal
MAPREDUCE-4483 | 2.0 build does not work | Major | . | John George | John George
HADOOP-8370 | Native build failure: javah: class file for org.apache.hadoop.classification.InterfaceAudience not found | Major | native | Trevor Robinson | Trevor Robinson
MAPREDUCE-4457 | mr job invalid transition TA_TOO_MANY_FETCH_FAILURE at FAILED | Critical | mrv2 | Thomas Graves | Robert Joseph Evans
MAPREDUCE-4444 | nodemanager fails to start when one of the local-dirs is bad | Blocker | nodemanager | Nathan Roberts | Jason Lowe
HDFS-3738 | TestDFSClientRetries#testFailuresArePerOperation sets incorrect timeout config | Minor | test | Aaron T. Myers | Aaron T. Myers
HADOOP-8633 | Interrupted FsShell copies may leave tmp files | Critical | fs | Daryn Sharp | Daryn Sharp
HADOOP-8480 | The native build should honor -DskipTests | Trivial | . | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-4504 | SortValidator writes to wrong directory | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans
HDFS-3724 | add InterfaceAudience annotations to HttpFS classes and making inner enum static | Major | . | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3756 | DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configured | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4503 | Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-4498 | Remove hsqldb jar from Hadoop runtime classpath | Critical | build, examples | Robert Kanter | Robert Kanter
HDFS-3579 | libhdfs: fix exception handling | Major | libhdfs | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-4494 | TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists! | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan
MAPREDUCE-4484 | Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration | Major | mrv2 | Ahmed Radwan | Ahmed Radwan
HDFS-3760 | primitiveCreate is a write, not a read | Minor | hdfs-client | Andy Isaacson | Andy Isaacson
HADOOP-8660 | TestPseudoAuthenticator failing with NPE | Major | . | Eli Collins | Alejandro Abdelnur
YARN-12 | Several Findbugs issues with new FairScheduler in YARN | Major | scheduler | Junping Du | Junping Du
HDFS-3710 | libhdfs misuses O_RDONLY/WRONLY/RDWR | Minor | libhdfs | Andy Isaacson | Andy Isaacson
HDFS-3755 | Creating an already-open-for-write file with overwrite=true fails | Major | namenode | Todd Lipcon | Todd Lipcon
YARN-13 | Merge of yarn reorg into branch-2 copied trunk tree | Critical | . | Todd Lipcon |
MAPREDUCE-3782 | teragen terasort jobs fail when using webhdfs:// | Critical | mrv2 | Arpit Gupta | Jason Lowe
YARN-14 | Symlinks to peer distributed cache files no longer work | Major | nodemanager | Jason Lowe | Jason Lowe
HDFS-3721 | hsync support broke wire compatibility | Critical | datanode, hdfs-client | Todd Lipcon | Aaron T. Myers
HDFS-3758 | TestFuseDFS test failing | Minor | fuse-dfs | Colin P. McCabe | Colin P. McCabe
HDFS-3754 | BlockSender doesn’t shutdown ReadaheadPool threads | Major | datanode | Eli Collins | Eli Collins
HADOOP-8659 | Native libraries must build with soft-float ABI for Oracle JVM on ARM | Major | native | Trevor Robinson | Colin P. McCabe
MAPREDUCE-4053 | Counters group names deprecation is wrong, iterating over group names deprecated names don’t show up | Major | mrv2 | Alejandro Abdelnur | Robert Joseph Evans
HDFS-3790 | test_fuse_dfs.c doesn’t compile on centos 5 | Minor | fuse-dfs | Colin P. McCabe | Colin P. McCabe
HDFS-3658 | TestDFSClientRetries#testNamenodeRestart failed | Major | . | Eli Collins | Tsz Wo Nicholas Sze
HDFS-3718 | Datanode won’t shutdown because of runaway DataBlockScanner thread | Critical | datanode | Kihwal Lee | Kihwal Lee
HDFS-3794 | WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header. | Major | webhdfs | Ravi Prakash | Ravi Prakash
HADOOP-8699 | some common testcases create core-site.xml in test-classes making other testcases to fail | Critical | test | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-8703 | distcpV2: turn CRC checking off for 0 byte size | Major | . | Dave Thompson | Dave Thompson
HDFS-3048 | Small race in BlockManager#close | Major | namenode | Eli Collins | Andy Isaacson
MAPREDUCE-4562 | Support for “FileSystemCounter” legacy counter group name for compatibility reasons is creating incorrect counter name | Major | . | Jarek Jarcec Cecho | Jarek Jarcec Cecho
HADOOP-8654 | TextInputFormat delimiter bug:- Input Text portion ends with & Delimiter starts with same char/char sequence | Major | util | Gelesh |
HDFS-2963 | Console Output is confusing while executing metasave (dfsadmin command) | Minor | . | J.Andreina | Andrew Wang
HADOOP-8390 | TestFileSystemCanonicalization fails with JDK7 | Major | test | Trevor Robinson | Trevor Robinson
HDFS-3808 | fuse_dfs: postpone libhdfs intialization until after fork | Critical | fuse-dfs | Colin P. McCabe | Colin P. McCabe
HDFS-3788 | distcp can’t copy large files using webhdfs due to missing Content-Length header | Critical | webhdfs | Eli Collins | Tsz Wo Nicholas Sze
HADOOP-8692 | TestLocalDirAllocator fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson
HADOOP-8693 | TestSecurityUtil fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson
HADOOP-8697 | TestWritableName fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson
YARN-25 | remove old aggregated logs | Major | . | Thomas Graves | Robert Joseph Evans
HADOOP-8695 | TestPathData fails intermittently with JDK7 | Major | test | Trevor Robinson | Trevor Robinson
HDFS-3816 | Invalidate work percentage default value should be 0.32f instead of 32 | Major | namenode | Jing Zhao | Jing Zhao
HADOOP-7967 | Need generalized multi-token filesystem support | Critical | fs, security | Daryn Sharp | Daryn Sharp
YARN-27 | Failed refreshQueues due to misconfiguration prevents further refreshing of queues | Major | . | Ramya Sunil | Arun C Murthy
YARN-58 | NM leaks filesystems | Critical | nodemanager | Daryn Sharp | Jason Lowe
HDFS-3803 | BlockPoolSliceScanner new work period notice is very chatty at INFO level | Minor | datanode | Andrew Purtell |
HADOOP-8611 | Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails | Major | security | Kihwal Lee | Robert Parker
HADOOP-8686 | Fix warnings in native code | Minor | native | Colin P. McCabe | Colin P. McCabe
HDFS-3707 | TestFSInputChecker: improper use of skip | Minor | . | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-3506 | Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException | Minor | client, mrv2 | Ratandeep Ratti | Jason Lowe
MAPREDUCE-4570 | ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/<pid>/stat is not found. | Minor | mrv2 | Ahmed Radwan | Ahmed Radwan
HDFS-3194 | DataNode block scanner is running too frequently | Major | datanode | suja s | Andy Isaacson
YARN-22 | Using URI for yarn.nodemanager log dirs fails | Minor | . | Eli Collins | Mayank Bansal
HADOOP-8720 | TestLocalFileSystem should use test root subdirectory | Trivial | test | Vlad Rozov | Vlad Rozov
HDFS-3830 | test_libhdfs_threaded: use forceNewInstance | Minor | libhdfs | Colin P. McCabe | Colin P. McCabe
HDFS-3832 | Remove protocol methods related to DistributedUpgrade | Major | datanode, namenode | Suresh Srinivas | Suresh Srinivas
HDFS-3835 | Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens | Major | namenode, security | Aaron T. Myers | Aaron T. Myers
HADOOP-8721 | ZKFC should not retry 45 times when attempting a graceful fence during a failover | Critical | auto-failover, ha | suja s | Vinayakumar B
MAPREDUCE-4068 | Jars in lib subdirectory of the submittable JAR are not added to the classpath | Blocker | mrv2 | Ahmed Radwan | Robert Kanter
MAPREDUCE-4577 | HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test | Minor | test | Alejandro Abdelnur | Aaron T. Myers
MAPREDUCE-4470 | Fix TestCombineFileInputFormat.testForEmptyFile | Major | test | Kihwal Lee | Ilya Katsov
HDFS-3841 | Port HDFS-3835 to branch-0.23 | Major | . | Robert Joseph Evans | Robert Joseph Evans
HADOOP-8632 | Configuration leaking class-loaders | Major | conf | Costin Leau | Costin Leau
HADOOP-8655 | In TextInputFormat, while specifying textinputformat.record.delimiter the character/character sequences in data file similar to starting character/starting character sequence in delimiter were found missing in certain cases in the Map Output | Major | util | Arun A K |
HADOOP-8225 | DistCp fails when invoked by Oozie | Blocker | security | Mithun Radhakrishnan | Daryn Sharp
MAPREDUCE-2374 | “Text File Busy” errors launching MR tasks | Major | . | Todd Lipcon | Andy Isaacson
HADOOP-8709 | globStatus changed behavior from 0.20/1.x | Critical | fs | Jason Lowe | Jason Lowe
HDFS-3715 | Fix TestFileCreation#testFileCreationNamenodeRestart | Major | test | Eli Collins | Andrew Wang
HADOOP-8725 | MR is broken when security is off | Blocker | security | Daryn Sharp | Daryn Sharp
HDFS-3177 | Allow DFSClient to find out and use the CRC type being used for a file. | Major | datanode, hdfs-client | Kihwal Lee | Kihwal Lee
HDFS-3683 | Edit log replay progress indicator shows >100% complete | Minor | namenode | Todd Lipcon | Plamen Jeliazkov
HDFS-3853 | Port MiniDFSCluster enableManagedDfsDirsRedundancy option to branch-2 | Minor | namenode | Colin P. McCabe | Colin P. McCabe
HADOOP-8060 | Add a capability to discover and set checksum types per file. | Major | fs, util | Kihwal Lee | Kihwal Lee
YARN-37 | TestRMAppTransitions.testAppSubmittedKilled passes for the wrong reason | Minor | resourcemanager | Jason Lowe | Mayank Bansal
MAPREDUCE-4580 | Change MapReduce to use the yarn-client module | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
HDFS-3856 | TestHDFSServerPorts failure is causing surefire fork failure | Blocker | test | Thomas Graves | Eli Collins
MAPREDUCE-4579 | TestTaskAttempt fails jdk7 | Major | . | Thomas Graves | Thomas Graves
YARN-31 | TestDelegationTokenRenewer fails on jdk7 | Major | . | Thomas Graves | Thomas Graves
HDFS-3860 | HeartbeatManager#Monitor may wrongly hold the writelock of namesystem | Major | . | Jing Zhao | Jing Zhao
MAPREDUCE-4600 | TestTokenCache.java from MRV1 no longer compiles | Critical | . | Robert Joseph Evans | Daryn Sharp
HDFS-3849 | When re-loading the FSImage, we should clear the existing genStamp and leases. | Critical | namenode | Colin P. McCabe | Colin P. McCabe
HDFS-3864 | NN does not update internal file mtime for OP_CLOSE when reading from the edit log | Major | namenode | Aaron T. Myers | Aaron T. Myers
HADOOP-8737 | cmake: always use JAVA_HOME to find libjvm.so, jni.h, jni_md.h | Minor | native | Colin P. McCabe | Colin P. McCabe
HADOOP-8614 | IOUtils#skipFully hangs forever on EOF | Minor | . | Colin P. McCabe | Colin P. McCabe
HADOOP-8747 | Syntax error on cmake version 2.6 patch 2 in JNIFlags.cmake | Major | native | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-4608 | hadoop-mapreduce-client is missing some dependencies | Major | build | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4610 | Support deprecated mapreduce.job.counters.limit property in MR2 | Major | mrv2 | Tom White | Tom White
HDFS-3861 | Deadlock in DFSClient | Blocker | hdfs-client | Kihwal Lee | Kihwal Lee
HADOOP-8726 | The Secrets in Credentials are not available to MR tasks | Major | security | Benoy Antony | Daryn Sharp
HADOOP-8031 | Configuration class fails to find embedded .jar resources; should use URL.openStream() | Major | conf | Elias Ross | Elias Ross
MAPREDUCE-4569 | TestHsWebServicesJobsQuery fails on jdk7 | Major | . | Thomas Graves | Thomas Graves
HDFS-3837 | Fix DataNode.recoverBlock findbugs warning | Major | datanode | Eli Collins | Eli Collins
HADOOP-8722 | Update BUILDING.txt with latest snappy info | Minor | documentation | Eli Collins | Colin P. McCabe
HDFS-3733 | Audit logs should include WebHDFS access | Major | webhdfs | Andy Isaacson | Andy Isaacson
YARN-63 | RMNodeImpl is missing valid transitions from the UNHEALTHY state | Major | resourcemanager | Jason Lowe | Jason Lowe
HADOOP-8727 | Gracefully deprecate dfs.umaskmode in 2.x onwards | Major | conf | Harsh J | Harsh J
YARN-66 | aggregated logs permissions not set properly | Critical | nodemanager | Thomas Graves | Thomas Graves
MAPREDUCE-4612 | job summary file permissions not set when its created | Critical | . | Thomas Graves | Thomas Graves
HDFS-3833 | TestDFSShell fails on Windows due to file concurrent read write | Major | test | Brandon Li | Brandon Li
MAPREDUCE-4611 | MR AM dies badly when Node is decomissioned | Critical | . | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-4604 | In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. | Critical | mrv2 | Ravi Prakash | Ravi Prakash
HDFS-3873 | Hftp assumes security is disabled if token fetch fails | Major | hdfs-client | Daryn Sharp | Daryn Sharp
HDFS-3852 | TestHftpDelegationToken is broken after HADOOP-8225 | Major | hdfs-client, security | Aaron T. Myers | Daryn Sharp
HDFS-3879 | Fix findbugs warning in TransferFsImage on branch-2 | Minor | namenode | Eli Collins | Eli Collins
HDFS-3466 | The SPNEGO filter for the NameNode should come out of the web keytab file | Major | namenode, security | Owen O’Malley | Owen O’Malley
HDFS-3469 | start-dfs.sh will start zkfc, but stop-dfs.sh will not stop zkfc similarly. | Minor | auto-failover | Vinayakumar B | Vinayakumar B
HDFS-3888 | BlockPlacementPolicyDefault code cleanup | Minor | . | Jing Zhao | Jing Zhao
YARN-79 | Calling YarnClientImpl.close throws Exception | Major | client | Bikas Saha | Vinod Kumar Vavilapalli
YARN-42 | Node Manager throws NPE on startup | Major | nodemanager | Devaraj K | Devaraj K
HADOOP-8764 | CMake: HADOOP-8737 broke ARM build | Major | build | Trevor Robinson | Trevor Robinson
HDFS-1490 | TransferFSImage should timeout | Minor | namenode | Dmytro Molkov | Vinayakumar B
HDFS-3054 | distcp -skipcrccheck has no effect | Major | tools | patrick white | Colin P. McCabe
HADOOP-8770 | NN should not RPC to self to find trash defaults (causes deadlock) | Blocker | trash | Todd Lipcon | Eli Collins
YARN-68 | NodeManager will refuse to shutdown indefinitely due to container log aggregation | Major | nodemanager | patrick white | Daryn Sharp
YARN-83 | Change package of YarnClient to include apache | Major | client | Bikas Saha | Bikas Saha
MAPREDUCE-4635 | MR side of YARN-83. Changing package of YarnClient | Major | . | Bikas Saha | Bikas Saha
YARN-36 | branch-2.1.0-alpha doesn’t build | Blocker | . | Eli Collins | Radim Kolar
HADOOP-8648 | libhadoop: native CRC32 validation crashes when io.bytes.per.checksum=1 | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-8766 | FileContextMainOperationsBaseTest should randomize the root dir | Major | test | Eli Collins | Colin P. McCabe
YARN-87 | NM ResourceLocalizationService does not set permissions of local cache directories | Critical | nodemanager | Jason Lowe | Jason Lowe
HDFS-3890 | filecontext mkdirs doesn’t apply umask as expected | Critical | . | Thomas Graves | Thomas Graves
MAPREDUCE-4633 | history server doesn’t set permissions on all subdirs | Critical | jobhistoryserver | Thomas Graves | oss.wakayama
HADOOP-8749 | HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. | Major | conf | Ahmed Radwan | Ahmed Radwan
HDFS-3895 | hadoop-client must include commons-cli | Major | build | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4572 | Can not access user logs - Jetty is not configured by default to serve aliases/symlinks | Major | tasktracker, webapps | Ahmed Radwan | Ahmed Radwan
MAPREDUCE-4641 | Exception in commitJob marks job as successful in job history | Major | mrv2 | Jason Lowe | Jason Lowe
YARN-15 | YarnConfiguration DEFAULT_YARN_APPLICATION_CLASSPATH should be updated | Critical | nodemanager | Alejandro Abdelnur | Arun C Murthy
YARN-75 | RMContainer should handle a RELEASE event while RUNNING | Major | . | Siddharth Seth | Siddharth Seth
HADOOP-8431 | Running distcp wo args throws IllegalArgumentException | Major | . | Eli Collins | Sandy Ryza
MAPREDUCE-4642 | MiniMRClientClusterFactory should not use job.setJar() | Major | test | Robert Kanter | Robert Kanter
HADOOP-8775 | MR2 distcp permits non-positive value to -bandwidth option which causes job never to complete | Major | . | Sandy Ryza | Sandy Ryza
HDFS-2757 | Cannot read a local block that’s being written to when using the local read short circuit | Major | . | Jean-Daniel Cryans | Jean-Daniel Cryans
HADOOP-8781 | hadoop-config.sh should add JAVA_LIBRARY_PATH to LD_LIBRARY_PATH | Major | scripts | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4646 | client does not receive job diagnostics for failed jobs | Major | mrv2 | Jason Lowe | Jason Lowe
HDFS-3664 | BlockManager race when stopping active services | Major | test | Eli Collins | Colin P. McCabe
HDFS-3902 | TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken | Minor | . | Andy Isaacson | Andy Isaacson
HDFS-3928 | MiniDFSCluster should reset the first ExitException on shutdown | Major | test | Eli Collins | Eli Collins
HADOOP-8801 | ExitUtil#terminate should capture the exception stack trace | Major | . | Eli Collins | Eli Collins
YARN-108 | FSDownload can create cache directories with the wrong permissions | Critical | nodemanager | Jason Lowe | Jason Lowe
YARN-88 | DefaultContainerExecutor can fail to set proper permissions | Major | nodemanager | Jason Lowe | Jason Lowe
MAPREDUCE-4649 | mr-jobhistory-daemon.sh needs to be updated post YARN-1 | Major | jobhistoryserver | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-4647 | We should only unjar jobjar if there is a lib directory in it. | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans
HDFS-3972 | Trash emptier fails in secure HA cluster | Critical | namenode | Todd Lipcon | Todd Lipcon
HDFS-3731 | 2.0 release upgrade must handle blocks being written from 1.0 | Blocker | datanode | Suresh Srinivas | Kihwal Lee
YARN-106 | Nodemanager needs to set permissions of local directories | Major | nodemanager | Jason Lowe | Jason Lowe
MAPREDUCE-4691 | Historyserver can report “Unknown job” after RM says job has completed | Critical | jobhistoryserver, mrv2 | Jason Lowe | Robert Joseph Evans
MAPREDUCE-4689 | JobClient.getMapTaskReports on failed job results in NPE | Major | client | Jason Lowe | Jason Lowe
YARN-138 | Improve default config values for YARN | Major | resourcemanager, scheduler | Arun C Murthy | Harsh J
YARN-174 | TestNodeStatusUpdater is failing in trunk | Major | nodemanager | Robert Joseph Evans | Vinod Kumar Vavilapalli

### TESTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-3983 | TestTTResourceReporting can fail, and should just be deleted | Major | mrv1 | Robert Joseph Evans | Ravi Prakash
HADOOP-8283 | Allow tests to control token service value | Major | test | Daryn Sharp | Daryn Sharp
HDFS-3258 | Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node) | Major | test | Eli Collins | Junping Du
MAPREDUCE-4212 | TestJobClientGetJob sometimes fails | Major | test | Daryn Sharp | Daryn Sharp
HDFS-3606 | libhdfs: create self-contained unit test | Minor | libhdfs | Colin P. McCabe | Colin P. McCabe
HDFS-3665 | Add a test for renaming across file systems via a symlink | Major | test | Eli Collins | Eli Collins
HDFS-3709 | TestStartup tests still binding to the ephemeral port | Major | test | Eli Collins | Eli Collins
HDFS-3291 | add test that covers HttpFS working w/ a non-HDFS Hadoop filesystem | Major | . | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3634 | Add self-contained, mavenized fuse_dfs test | Minor | fuse-dfs | Colin P. McCabe | Colin P. McCabe

### SUB-TASKS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-2330 | In NNStorage.java, IOExceptions of stream closures can mask root exceptions. | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G
HDFS-3168 | Clean up FSNamesystem and BlockManager | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-3942 | Randomize master key generation for ApplicationTokenSecretManager and roll it every so often | Major | mrv2, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3972 | Locking and exception issues in JobHistory Server. | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-4161 | create sockets consistently | Major | client, mrv2 | Daryn Sharp | Daryn Sharp
MAPREDUCE-3613 | web service calls header contains 2 content types | Critical | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-4163 | consistently set the bind address | Major | mrv2 | Daryn Sharp | Daryn Sharp
MAPREDUCE-4162 | Correctly set token service | Major | client, mrv2 | Daryn Sharp | Daryn Sharp
HDFS-3369 | change variable names referring to inode in blockmanagement to more appropriate | Minor | namenode | John George | John George
HDFS-2717 | BookKeeper Journal output stream doesn’t check addComplete rc | Major | . | Ivan Kelly | Ivan Kelly
HDFS-3058 | HA: Bring BookKeeperJournalManager up to date with HA changes | Major | . | Ivan Kelly | Ivan Kelly
HDFS-3452 | BKJM:Switch from standby to active fails and NN gets shut down due to delay in clearing of lock | Blocker | . | suja s | Uma Maheswara Rao G
HDFS-3474 | Cleanup Exception handling in BookKeeper journal manager | Major | . | Ivan Kelly | Ivan Kelly
HDFS-3468 | Make BKJM-ZK session timeout configurable. | Major | . | Uma Maheswara Rao G | Uma Maheswara Rao G
HDFS-3423 | BKJM: NN startup is failing, when tries to recoverUnfinalizedSegments() a bad inProgress_ ZNodes | Major | . | Rakesh R | Ivan Kelly
HDFS-3441 | Race condition between rolling logs at active NN and purging at standby | Major | . | suja s | Rakesh R
HDFS-3502 | Change INodeFile and INodeFileUnderConstruction to package private | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-3408 | BKJM : Namenode format fails, if there is no BK root | Minor | namenode | Rakesh R | Rakesh R
HDFS-3389 | Document the BKJM usage in Namenode HA. | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G
HDFS-3190 | Simple refactors in existing NN code to assist QuorumJournalManager extension | Minor | namenode | Todd Lipcon | Todd Lipcon
MAPREDUCE-3940 | ContainerTokens should have an expiry interval | Major | mrv2, security | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
HADOOP-7754 | Expose file descriptors from Hadoop-wrapped local FileSystems | Major | native, performance | Todd Lipcon | Todd Lipcon
YARN-39 | RM-NM secret-keys should be randomly generated and rolled every so often | Critical | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
YARN-29 | Add a yarn-client module | Major | client | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
YARN-60 | NMs rejects all container tokens after secret key rolls | Blocker | nodemanager | Daryn Sharp | Vinod Kumar Vavilapalli

### OTHER:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-4051 | Remove the empty hadoop-mapreduce-project/assembly/all.xml file | Major | . | Ravi Prakash | Ravi Prakash
MAPREDUCE-4134 | Remove references of mapred.child.ulimit etc. since they are not being used any more | Major | mrv2 | Ravi Prakash | Ravi Prakash
HADOOP-8403 | bump up POMs version to 2.0.1-SNAPSHOT | Major | build | Alejandro Abdelnur | Alejandro Abdelnur
YARN-1 | Move YARN out of hadoop-mapreduce | Major | . | Arun C Murthy | Arun C Murthy
YARN-154 | Create Yarn trunk and commit jobs | Major | . | Eli Collins | Robert Joseph Evans