Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 1.2.0 - 2013-05-13

### INCOMPATIBLE CHANGES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-8164 | Handle paths using back slash as path separator for windows only | Major | fs | Suresh Srinivas | Daryn Sharp
MAPREDUCE-4629 | Remove JobHistory.DEBUG_MODE | Major | . | Karthik Kambatla | Karthik Kambatla
HDFS-4122 | Cleanup HDFS logs and reduce the size of logged messages | Major | datanode, hdfs-client, namenode | Suresh Srinivas | Suresh Srinivas
HDFS-4350 | Make enabling of stale marking on read and write paths independent | Major | . | Andrew Wang | Andrew Wang
MAPREDUCE-4737 | Hadoop does not close output file / does not call Mapper.cleanup if exception in map | Major | . | Daniel Dai | Arun C Murthy

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-461 | Enable ServicePlugins for the JobTracker | Minor | . | Fredrik Hedberg | Fredrik Hedberg
HDFS-3515 | Port HDFS-1457 to branch-1 | Major | namenode | Eli Collins | Eli Collins
HADOOP-8023 | Add unset() method to Configuration | Critical | conf | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4355 | Add RunningJob.getJobStatus() | Major | mrv1, mrv2 | Karthik Kambatla | Karthik Kambatla
MAPREDUCE-987 | Exposing MiniDFS and MiniMR clusters as a single process command-line | Minor | build, test | Philip Zeyliger | Ahmed Radwan
MAPREDUCE-3678 | The Map tasks logs should have the value of input split it processed | Major | mrv1, mrv2 | Bejoy KS | Harsh J
HADOOP-8988 | Backport HADOOP-8343 to branch-1 | Major | conf | Jing Zhao | Jing Zhao
HADOOP-8820 | Backport HADOOP-8469 and HADOOP-8470: add “NodeGroup” layer in new NetworkTopology (also known as NetworkTopologyWithNodeGroup) | Major | net | Junping Du | Junping Du
HDFS-3941 | Backport HDFS-3498 and HDFS3601: update replica placement policy for new added “NodeGroup” layer topology | Major | namenode | Junping Du | Junping Du
HDFS-4219 | Port slive to branch-1 | Major | . | Arpit Gupta | Arpit Gupta
HADOOP-9090 | Support on-demand publish of metrics | Minor | metrics | Mostafa Elhemali | Mostafa Elhemali
HDFS-3942 | Backport HDFS-3495: Update balancer policy for Network Topology with additional ‘NodeGroup’ layer | Major | balancer & mover | Junping Du | Junping Du
MAPREDUCE-4660 | Update task placement policy for NetworkTopology with ‘NodeGroup’ layer | Major | jobtracker, mrv1, scheduler | Junping Du | Junping Du
HDFS-4597 | Backport WebHDFS concat to branch-1 | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-5081 | Backport DistCpV2 and the related JIRAs to branch-1 | Major | distcp | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-4824 | Provide a mechanism for jobs to indicate they should not be recovered on restart | Major | mrv1 | Tom White | Tom White
MAPREDUCE-5129 | Add tag info to JH files | Minor | . | Billie Rinaldi | Billie Rinaldi
HDFS-4776 | Backport SecondaryNameNode web ui to branch-1 | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-4774 | Backport HDFS-4525 ‘Provide an API for knowing whether file is closed or not’ to branch-1 | Major | hdfs-client, namenode | Ted Yu | Ted Yu
HDFS-3601 | Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology | Major | namenode | Junping Du | Junping Du
HDFS-3495 | Update Balancer to support new NetworkTopology with NodeGroup | Major | balancer & mover | Junping Du | Junping Du

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-385 | Design a pluggable interface to place replicas of blocks in HDFS | Major | . | dhruba borthakur | dhruba borthakur
HADOOP-7096 | Allow setting of end-of-record delimiter for TextInputFormat | Major | . | Ahmed Radwan | Ahmed Radwan
HDFS-1957 | Documentation for HFTP | Minor | documentation | Ari Rabkin | Ari Rabkin
HDFS-2533 | Remove needless synchronization on FSDataSet.getBlockFile | Minor | datanode, performance | Todd Lipcon | Todd Lipcon
HDFS-3163 | TestHDFSCLI.testAll fails if the user name is not all lowercase | Trivial | test | Brandon Li | Brandon Li
HDFS-3479 | backport HDFS-3335 (check for edit log corruption at the end of the log) to branch-1 | Major | . | Colin P. McCabe | Colin P. McCabe
HDFS-3521 | Allow namenode to tolerate edit log corruption | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-3604 | Add dfs.webhdfs.enabled to hdfs-default.xml | Minor | . | Eli Collins | Eli Collins
HDFS-3596 | Improve FSEditLog pre-allocation in branch-1 | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-3647 | Backport HDFS-2868 (Add number of active transfer threads to the DataNode status) to branch-1 | Major | datanode | Steve Hoffman | Harsh J
MAPREDUCE-4415 | Backport the Job.getInstance methods from MAPREDUCE-1505 to branch-1 | Major | mrv1 | Harsh J | Harsh J
HDFS-3697 | Enable fadvise readahead by default | Minor | datanode, performance | Todd Lipcon | Todd Lipcon
HADOOP-8711 | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li
MAPREDUCE-4565 | Backport MR-2855 to branch-1: ResourceBundle lookup during counter name resolution takes a lot of time | Major | . | Karthik Kambatla | Karthik Kambatla
HDFS-3817 | avoid printing stack information for SafeModeException | Major | namenode | Brandon Li | Brandon Li
HDFS-3819 | Should check whether invalidate work percentage default value is not greater than 1.0f | Minor | . | Jing Zhao | Jing Zhao
HDFS-3838 | fix the typo in FSEditLog.java: isToterationEnabled should be isTolerationEnabled | Trivial | namenode | Brandon Li | Brandon Li
MAPREDUCE-4408 | allow jobs to set a JAR that is in the distributed cached | Major | mrv1, mrv2 | Alejandro Abdelnur | Robert Kanter
MAPREDUCE-4499 | Looking for speculative tasks is very expensive in 1.x | Major | mrv1, performance | Nathan Roberts | Koji Noguchi
HADOOP-7688 | When a servlet filter throws an exception in init(..), the Jetty server failed silently. | Major | . | Tsz Wo Nicholas Sze | Uma Maheswara Rao G
MAPREDUCE-2770 | Improve hadoop.job.history.location doc in mapred-default.xml | Trivial | documentation | Eli Collins | Sandy Ryza
MAPREDUCE-4464 | Reduce tasks failing with NullPointerException in ConcurrentHashMap.get() | Minor | task | Clint Heath | Clint Heath
MAPREDUCE-4556 | FairScheduler: PoolSchedulable#updateDemand() has potential redundant computation | Minor | contrib/fair-share | Karthik Kambatla | Karthik Kambatla
HADOOP-8931 | Add Java version to startup message | Trivial | . | Eli Collins | Eli Collins
HDFS-4057 | NameNode.namesystem should be private. Use getNamesystem() instead. | Minor | namenode | Brandon Li | Brandon Li
HADOOP-8951 | RunJar to fail with user-comprehensible error message if jar missing | Minor | util | Steve Loughran | Steve Loughran
HDFS-4062 | In branch-1, FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock should print logs outside of the namesystem lock | Minor | . | Jing Zhao | Jing Zhao
HADOOP-8971 | Backport: hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (HADOOP-8926) | Major | util | Gopal V | Gopal V
HADOOP-8968 | Add a flag to completely disable the worker version check | Major | . | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4703 | Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. | Major | mrv1, mrv2, test | Ahmed Radwan | Ahmed Radwan
MAPREDUCE-4845 | ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2 | Major | client | Sandy Ryza | Sandy Ryza
HDFS-4320 | Add a separate configuration for namenode rpc address instead of only using fs.default.name | Major | datanode, namenode | Mostafa Elhemali | Mostafa Elhemali
MAPREDUCE-4907 | TrackerDistributedCacheManager issues too many getFileStatus calls | Major | mrv1, tasktracker | Sandy Ryza | Sandy Ryza
MAPREDUCE-2931 | CLONE - LocalJobRunner should support parallel mapper execution | Major | . | Forest Tan | Sandy Ryza
MAPREDUCE-4837 | Add webservices for jobtracker | Major | . | Arun C Murthy | Arun C Murthy
HDFS-4551 | Change WebHDFS buffersize behavior to improve default performance | Major | webhdfs | Mark Wagner | Mark Wagner
HADOOP-9379 | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta
HADOOP-9434 | Backport HADOOP-9267 to branch-1 | Minor | bin | Yu Li | Yu Li
HDFS-4635 | Move BlockManager#computeCapacity to LightWeightGSet | Major | namenode | Suresh Srinivas | Suresh Srinivas
HADOOP-9253 | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta
HDFS-4651 | Offline Image Viewer backport to branch-1 | Major | tools | Chris Nauroth | Chris Nauroth
HADOOP-9071 | configure ivy log levels for resolve/retrieve | Major | build | Giridharan Kesavan | Giridharan Kesavan
HDFS-3940 | Add Gset#clear method and clear the block map when namenode is shutdown | Minor | . | Eli Collins | Suresh Srinivas
HDFS-3498 | Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass | Major | namenode | Junping Du | Junping Du

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-7101 | UserGroupInformation.getCurrentUser() fails when called from non-Hadoop JAAS context | Blocker | security | Todd Lipcon | Todd Lipcon
HDFS-2827 | Cannot save namespace after renaming a directory above a file with an open lease | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G
HADOOP-8355 | SPNEGO filter throws/logs exception when authentication fails | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-8460 | Document proper setting of HADOOP_PID_DIR and HADOOP_SECURE_DN_PID_DIR | Major | documentation | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-4195 | With invalid queueName request param, jobqueue_details.jsp shows NPE | Critical | jobtracker | Gera Shegalov |
MAPREDUCE-3727 | jobtoken location property in jobconf refers to wrong jobtoken file | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-8512 | AuthenticatedURL should reset the Token when the server returns other than OK on authentication | Minor | security | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-7868 | Hadoop native fails to compile when default linker option is -Wl,–as-needed | Major | native | James Page | Trevor Robinson
MAPREDUCE-2289 | Permissions race can make getStagingDir fail on local filesystem | Major | job submission | Todd Lipcon | Ahmed Radwan
HADOOP-8249 | invalid hadoop-auth cookies should trigger authentication if info is avail before returning HTTP 401 | Major | security | bc Wong | Alejandro Abdelnur
HDFS-3595 | TestEditLogLoading fails in branch-1 | Major | namenode | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-4317 | Job view ACL checks are too permissive | Major | mrv1 | Harsh J | Karthik Kambatla
MAPREDUCE-4385 | FairScheduler.maxTasksToAssign() should check for fairscheduler.assignmultiple.maps < TaskTracker.availableSlots | Major | . | Karthik Kambatla | Karthik Kambatla
MAPREDUCE-4359 | Potential deadlock in Counters | Major | . | Todd Lipcon | Tom White
MAPREDUCE-3993 | Graceful handling of codec errors during decompression | Major | mrv1, mrv2 | Todd Lipcon | Karthik Kambatla
HDFS-3628 | The dfsadmin -setBalancerBandwidth command on branch-1 does not check for superuser privileges | Blocker | datanode, namenode | Harsh J | Harsh J
HADOOP-8586 | Fixup a bunch of SPNEGO misspellings | Major | . | Eli Collins | Eli Collins
HADOOP-8587 | HarFileSystem access of harMetaCache isn’t threadsafe | Minor | fs | Eli Collins | Eli Collins
HADOOP-7836 | TestSaslRPC#testDigestAuthMethodHostBasedToken fails with hostname localhost.localdomain | Minor | ipc, test | Eli Collins | Daryn Sharp
HADOOP-8423 | MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data | Major | io | Jason B | Todd Lipcon
HADOOP-8612 | Backport HADOOP-8599 to branch-1 (Non empty response when read beyond eof) | Major | fs | Matt Foley | Eli Collins
HADOOP-8606 | FileSystem.get may return the wrong filesystem | Major | fs | Daryn Sharp | Daryn Sharp
HADOOP-8613 | AbstractDelegationTokenIdentifier#getUser() should set token auth type | Critical | . | Daryn Sharp | Daryn Sharp
HDFS-3679 | fuse_dfs notrash option sets usetrash | Minor | fuse-dfs | Conrad Meyer | Conrad Meyer
MAPREDUCE-4036 | Streaming TestUlimit fails on CentOS 6 | Major | test | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3754 | BlockSender doesn’t shutdown ReadaheadPool threads | Major | datanode | Eli Collins | Eli Collins
HADOOP-8611 | Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails | Major | security | Kihwal Lee | Robert Parker
MAPREDUCE-4595 | TestLostTracker failing - possibly due to a race in JobHistory.JobHistoryFilesManager#run() | Critical | . | Karthik Kambatla | Karthik Kambatla
MAPREDUCE-1684 | ClusterStatus can be cached in CapacityTaskScheduler.assignTasks() | Major | capacity-sched | Amareshwari Sriramadasu | Koji Noguchi
MAPREDUCE-4572 | Can not access user logs - Jetty is not configured by default to serve aliases/symlinks | Major | tasktracker, webapps | Ahmed Radwan | Ahmed Radwan
HDFS-2757 | Cannot read a local block that’s being written to when using the local read short circuit | Major | . | Jean-Daniel Cryans | Jean-Daniel Cryans
HADOOP-8781 | hadoop-config.sh should add JAVA_LIBRARY_PATH to LD_LIBRARY_PATH | Major | scripts | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-4576 | Large dist cache can block tasktracker heartbeat | Major | . | Robert Joseph Evans | Robert Joseph Evans
HADOOP-8767 | secondary namenode on slave machines | Minor | bin | giovanni delussu | giovanni delussu
HADOOP-8819 | Should use && instead of & in a few places in FTPFileSystem,FTPInputStream,S3InputStream,ViewFileSystem,ViewFs | Major | fs | Brandon Li | Brandon Li
HADOOP-8786 | HttpServer continues to start even if AuthenticationFilter fails to init | Major | . | Todd Lipcon | Todd Lipcon
HDFS-3961 | FSEditLog preallocate() needs to reset the position of PREALLOCATE_BUFFER when more than 1MB size is needed | Major | . | Jing Zhao | Jing Zhao
HADOOP-8832 | backport serviceplugin to branch-1 | Major | . | Brandon Li | Brandon Li
HDFS-3963 | backport namenode/datanode serviceplugin to branch-1 | Major | . | Brandon Li | Brandon Li
HDFS-3698 | TestHftpFileSystem is failing in branch-1 due to changed default secure port | Major | security | Aaron T. Myers | Aaron T. Myers
HADOOP-7698 | jsvc target fails on x86_64 | Critical | build | Daryn Sharp | Daryn Sharp
MAPREDUCE-4652 | ValueAggregatorJob sets the wrong job jar | Major | examples, mrv1 | Ahmed Radwan | Ahmed Radwan
MAPREDUCE-4662 | JobHistoryFilesManager thread pool never expands | Major | jobhistoryserver | Thomas Graves | Kihwal Lee
HADOOP-8791 | rm “Only deletes non empty directory and files.” | Major | documentation | Bertrand Dechoux | Jing Zhao
HADOOP-8386 | hadoop script doesn’t work if ‘cd’ prints to stdout (default behavior in Ubuntu) | Major | scripts | Christopher Berner | Christopher Berner
MAPREDUCE-4706 | FairScheduler#dump(): Computing of # running maps and reduces is commented out | Critical | contrib/fair-share | Karthik Kambatla | Karthik Kambatla
MAPREDUCE-4451 | fairscheduler fail to init job with kerberos authentication configured | Major | contrib/fair-share | Erik.fang | Erik.fang
HADOOP-6496 | HttpServer sends wrong content-type for CSS files (and others) | Minor | . | Lars Francke | Ivan Mitic
HADOOP-7827 | jsp pages missing DOCTYPE | Trivial | . | Dave Vronay | Dave Vronay
HDFS-3402 | Fix hdfs scripts for secure datanodes | Minor | scripts, security | Benoy Antony | Benoy Antony
HDFS-4072 | On file deletion remove corresponding blocks pending replication | Minor | namenode | Jing Zhao | Jing Zhao
HADOOP-8861 | FSDataOutputStream.sync should call flush() if the underlying wrapped stream is not Syncable | Major | fs | Amareshwari Sriramadasu | Amareshwari Sriramadasu
HDFS-3540 | Further improvement on recovery mode and edit log toleration in branch-1 | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-8900 | BuiltInGzipDecompressor throws IOException - stored gzip size doesn’t match decompressed size | Major | . | Slavik Krassovsky | Andy Isaacson
MAPREDUCE-1806 | CombineFileInputFormat does not work with paths not on default FS | Major | harchive | Paul Yang | Gera Shegalov
MAPREDUCE-4765 | Restarting the JobTracker programmatically can cause DelegationTokenRenewal to throw an exception | Minor | jobtracker, mrv1 | Robert Kanter | Robert Kanter
HDFS-4168 | TestDFSUpgradeFromImage fails in branch-1 | Major | namenode | Tsz Wo Nicholas Sze | Jing Zhao
HADOOP-8963 | CopyFromLocal doesn’t always create user directory | Trivial | . | Billie Rinaldi | Arpit Gupta
HDFS-4180 | TestFileCreation fails in branch-1 but not branch-1.1 | Minor | test | Tsz Wo Nicholas Sze | Jing Zhao
HADOOP-9036 | TestSinkQueue.testConcurrentConsumers fails intermittently (Backports HADOOP-7292) | Major | . | Ivan Mitic | Suresh Srinivas
HDFS-4207 | All hadoop fs operations fail if the default fs is down even if a different file system is specified in the command | Minor | hdfs-client | Steve Loughran | Jing Zhao
HADOOP-9095 | TestNNThroughputBenchmark fails in branch-1 | Minor | net | Tsz Wo Nicholas Sze | Jing Zhao
MAPREDUCE-4778 | Fair scheduler event log is only written if directory exists on HDFS | Major | jobtracker, scheduler | Sandy Ryza | Sandy Ryza
HADOOP-9098 | Add missing license headers | Blocker | build | Tom White | Arpit Agarwal
MAPREDUCE-4860 | DelegationTokenRenewal attempts to renew token even after a job is removed | Major | security | Karthik Kambatla | Karthik Kambatla
MAPREDUCE-4806 | Cleanup: Some (5) private methods in JobTracker.RecoveryManager are not used anymore after MAPREDUCE-3837 | Major | mrv1 | Karthik Kambatla | Karthik Kambatla
HDFS-4337 | Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup. | Major | namenode | Junping Du | meng gong
MAPREDUCE-2217 | The expire launching task should cover the UNASSIGNED task | Major | jobtracker | Scott Chen | Karthik Kambatla
MAPREDUCE-4909 | TestKeyValueTextInputFormat fails with Open JDK 7 on Windows | Major | test | Arpit Agarwal | Arpit Agarwal
HDFS-4355 | TestNameNodeMetrics.testCorruptBlock fails with open JDK7 | Major | test | Brandon Li | Brandon Li
HDFS-4358 | TestCheckpoint failure with JDK7 | Major | test | Arpit Agarwal | Arpit Agarwal
MAPREDUCE-4904 | TestMultipleLevelCaching failed in branch-1 | Major | test | meng gong | Junping Du
HADOOP-9179 | TestFileSystem fails with open JDK7 | Major | . | Brandon Li | Brandon Li
MAPREDUCE-4916 | TestTrackerDistributedCacheManager is flaky due to other badly written tests in branch-1 | Major | . | Arun C Murthy | Xuan Gong
MAPREDUCE-4914 | TestMiniMRDFSSort fails with openJDK7 | Major | test | Brandon Li | Brandon Li
MAPREDUCE-4915 | TestShuffleExceptionCount fails with open JDK7 | Major | test | Brandon Li | Brandon Li
HDFS-4351 | Fix BlockPlacementPolicyDefault#chooseTarget when avoiding stale nodes | Major | namenode | Andrew Wang | Andrew Wang
MAPREDUCE-4278 | cannot run two local jobs in parallel from the same gateway. | Major | . | Araceli Henley | Sandy Ryza
HADOOP-9191 | TestAccessControlList and TestJobHistoryConfig fail with JDK7 | Major | test | Arpit Agarwal | Arpit Agarwal
MAPREDUCE-4850 | Job recovery may fail if staging directory has been deleted | Major | mrv1 | Tom White | Tom White
MAPREDUCE-4930 | Backport MAPREDUCE-4678 and MAPREDUCE-4925 to branch-1 | Major | examples | Karthik Kambatla | Karthik Kambatla
MAPREDUCE-4924 | flakey test: org.apache.hadoop.mapred.TestClusterMRNotification.testMR | Trivial | mrv1 | Robert Kanter | Robert Kanter
MAPREDUCE-4315 | jobhistory.jsp throws 500 when a .txt file is found in /done | Major | jobhistoryserver | Alexander Alten-Lorenz | Sandy Ryza
MAPREDUCE-4923 | Add toString method to TaggedInputSplit | Minor | mrv1, mrv2, task | Sandy Ryza | Sandy Ryza
HADOOP-8580 | ant compile-native fails with automake version 1.11.3 | Major | . | Eugene Koontz |
MAPREDUCE-4929 | mapreduce.task.timeout is ignored | Major | mrv1 | Sandy Ryza | Sandy Ryza
MAPREDUCE-4963 | StatisticsCollector improperly keeps track of “Last Day” and “Last Hour” statistics for new TaskTrackers | Major | mrv1 | Robert Kanter | Robert Kanter
MAPREDUCE-4962 | jobdetails.jsp uses display name instead of real name to get counters | Major | jobtracker, mrv1 | Sandy Ryza | Sandy Ryza
HDFS-4444 | Add space between total transaction time and number of transactions in FSEditLog#printStatistics | Trivial | . | Stephen Chu | Stephen Chu
MAPREDUCE-2264 | Job status exceeds 100% in some cases | Major | jobtracker | Adam Kramer | Devaraj K
MAPREDUCE-4969 | TestKeyValueTextInputFormat test fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal
MAPREDUCE-4843 | When using DefaultTaskController, JobLocalizer not thread safe | Critical | tasktracker | yunjiong zhao | Karthik Kambatla
MAPREDUCE-4967 | TestJvmReuse fails on assertion | Major | tasktracker, test | Chris Nauroth | Karthik Kambatla
MAPREDUCE-4434 | Backport MR-2779 (JobSplitWriter.java can’t handle large job.split file) to branch-1 | Major | mrv1 | Karthik Kambatla | Karthik Kambatla
MAPREDUCE-4970 | Child tasks (try to) create security audit log files | Major | . | Sandy Ryza | Sandy Ryza
HADOOP-9124 | SortedMapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Patrick Hunt | Surenkumar Nihalani
HDFS-4466 | Remove the deadlock from AbstractDelegationTokenSecretManager | Major | namenode, security | Brandon Li | Brandon Li
HADOOP-9154 | SortedMapWritable#putAll() doesn’t add key/value classes to the map | Major | io | Karthik Kambatla | Karthik Kambatla
MAPREDUCE-4643 | Make job-history cleanup-period configurable | Major | jobhistoryserver | Karthik Kambatla | Sandy Ryza
HDFS-4222 | NN is unresponsive and loses heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues | Minor | namenode | Xiaobo Peng | Xiaobo Peng
HDFS-4479 | logSync() with the FSNamesystem lock held in commitBlockSynchronization | Major | . | Jing Zhao | Jing Zhao
HADOOP-8917 | add LOCALE.US to toLowerCase in SecurityUtil.replacePattern | Major | . | Arpit Gupta | Arpit Gupta
MAPREDUCE-5008 | Merger progress miscounts with respect to EOF_MARKER | Major | . | Sandy Ryza | Sandy Ryza
MAPREDUCE-5035 | Update MR1 memory configuration docs | Major | mrv1 | Tom White | Tom White
MAPREDUCE-4933 | MR1 final merge asks for length of file it just wrote before flushing it | Major | mrv1, task | Sandy Ryza | Sandy Ryza
HDFS-4518 | Finer grained metrics for HDFS capacity | Major | . | Arpit Agarwal | Arpit Agarwal
HADOOP-9349 | Confusing output when running hadoop version from one hadoop installation when HADOOP_HOME points to another | Major | tools | Sandy Ryza | Sandy Ryza
HDFS-4519 | Support override of jsvc binary and log file locations when launching secure datanode. | Major | datanode, scripts | Chris Nauroth | Chris Nauroth
HDFS-4544 | Error in deleting blocks should not do check disk, for all types of errors | Major | . | Amareshwari Sriramadasu | Arpit Agarwal
MAPREDUCE-5049 | CombineFileInputFormat counts all compressed files non-splitable | Major | . | Sandy Ryza | Sandy Ryza
HADOOP-9369 | DNS#reverseDns() can return hostname with . appended at the end | Major | net | Karthik Kambatla | Karthik Kambatla
HDFS-4558 | start balancer failed with NPE | Critical | balancer & mover | Wenwu Peng | Junping Du
HADOOP-9099 | NetUtils.normalizeHostName fails on domains where UnknownHost resolves to an IP address | Minor | test | Ivan Mitic | Ivan Mitic
HADOOP-9451 | Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled | Major | net | Junping Du | Junping Du
MAPREDUCE-4463 | JobTracker recovery fails with HDFS permission issue | Blocker | mrv1 | Tom White | Tom White
MAPREDUCE-5131 | Provide better handling of job status related apis during JT restart | Major | . | Arun C Murthy | Arun C Murthy
HDFS-4413 | Secondary namenode won’t start if HDFS isn’t the default file system | Major | namenode | Mostafa Elhemali | Mostafa Elhemali
HADOOP-9467 | Metrics2 record filtering (.record.filter.include/exclude) does not filter by name | Major | metrics | Chris Nauroth | Chris Nauroth
MAPREDUCE-5066 | JobTracker should set a timeout when calling into job.end.notification.url | Major | . | Ivan Mitic | Ivan Mitic
HADOOP-9473 | typo in FileUtil copy() method | Trivial | fs | Glen Mazza |
HDFS-4715 | Backport HDFS-3577 and other related WebHDFS issue to branch-1 | Major | webhdfs | Tsz Wo Nicholas Sze | Mark Wagner
HADOOP-9492 | Fix the typo in testConf.xml to make it consistent with FileUtil#copy() | Trivial | test | Jing Zhao | Jing Zhao
MAPREDUCE-5169 | Job recovery fails if job tracker is restarted after the job is submitted but before its initialized | Major | . | Arpit Gupta | Arun C Murthy
HADOOP-9458 | In branch-1, RPC.getProxy(..) may call proxy.getProtocolVersion(..) without retry | Critical | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-9502 | chmod does not return error exit codes for some exceptions | Minor | fs | Ramya Sunil | Tsz Wo Nicholas Sze
MAPREDUCE-5166 | ConcurrentModificationException in LocalJobRunner | Blocker | . | Gunther Hagleitner | Sandy Ryza
MAPREDUCE-5158 | Cleanup required when mapreduce.job.restart.recover is set to false | Major | jobtracker | Yesha Vora | Mayank Bansal
MAPREDUCE-5198 | Race condition in cleanup during task tracker renint with LinuxTaskController | Major | tasktracker | Arpit Gupta | Arpit Gupta
MAPREDUCE-5154 | staging directory deletion fails because delegation tokens have been cancelled | Major | jobtracker | Sandy Ryza | Sandy Ryza
MAPREDUCE-5202 | Revert MAPREDUCE-4397 to avoid using incorrect config files | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-9537 | Backport AIX patches to branch-1 | Major | security | Arpit Agarwal | Arpit Agarwal
HADOOP-9543 | TestFsShellReturnCode may fail in branch-1 | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-9544 | backport UTF8 encoding fixes to branch-1 | Major | io | Chris Nauroth | Chris Nauroth
HADOOP-9375 | Port HADOOP-7290 to branch-1 to fix TestUserGroupInformation failure | Trivial | test | Xiaobo Peng | Suresh Srinivas
HDFS-4240 | In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup | Major | namenode | Junping Du | Junping Du
HDFS-3499 | Make NetworkTopology support user specified topology class | Major | datanode | Junping Du | Junping Du
MAPREDUCE-5028 | Maps fail when io.sort.mb is set to high value | Critical | . | Karthik Kambatla | Karthik Kambatla

### TESTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-9174 | TestSecurityUtil fails on Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal
HADOOP-9175 | TestWritableName fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal
HDFS-4256 | Backport concatenation of files into a single file to branch-1 | Major | namenode | Suresh Srinivas | Sanjay Radia

### SUB-TASKS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-7754 | Expose file descriptors from Hadoop-wrapped local FileSystems | Major | native, performance | Todd Lipcon | Todd Lipcon
HDFS-3912 | Detecting and avoiding stale datanodes for writing | Major | . | Jing Zhao | Jing Zhao
HDFS-4071 | Add number of stale DataNodes to metrics for Branch-1 | Minor | datanode, namenode | Jing Zhao | Jing Zhao
HADOOP-8817 | Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1 | Major | . | Junping Du | Junping Du
HADOOP-8469 | Make NetworkTopology class pluggable | Major | . | Junping Du | Junping Du
HADOOP-8470 | Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup) | Major | . | Junping Du | Junping Du