Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 0.23.1 - 2012-02-17

### INCOMPATIBLE CHANGES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-7348 | Modify the option of FsShell getmerge from [addnl] to [-nl] for consistency | Major | fs | XieXianshan | XieXianshan
MAPREDUCE-3720 | Command line listJobs should not visit each AM | Major | client, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
HADOOP-7470 | move up to Jackson 1.8.8 | Minor | util | Steve Loughran | Enis Soztutar
HADOOP-8013 | ViewFileSystem does not honor setVerifyChecksum | Major | fs | Daryn Sharp | Daryn Sharp

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-778 | [Rumen] Need a standalone JobHistory log anonymizer | Major | tools/rumen | Hong Tang | Amar Kamat
HADOOP-7808 | Port token service changes from 205 | Major | fs, security | Daryn Sharp | Daryn Sharp
MAPREDUCE-2765 | DistCp Rewrite | Major | distcp, mrv2 | Mithun Radhakrishnan | Mithun Radhakrishnan
HDFS-2316 | [umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-362 | FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items | Major | namenode | Tsz Wo Nicholas Sze | Uma Maheswara Rao G
HDFS-2349 | DN should log a WARN, not an INFO when it detects a corruption during block transfer | Trivial | datanode | Harsh J | Harsh J
HADOOP-7736 | Remove duplicate call of Path#normalizePath during initialization. | Trivial | fs | Harsh J | Harsh J
HADOOP-7761 | Improve performance of raw comparisons | Major | io, performance, util | Todd Lipcon | Todd Lipcon
HADOOP-7424 | Log an error if the topology script doesn’t handle multiple args | Major | . | Eli Collins | Uma Maheswara Rao G
HADOOP-7792 | Common component for HDFS-2416: Add verifyToken method to AbstractDelegationTokenSecretManager | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey
HDFS-2533 | Remove needless synchronization on FSDataSet.getBlockFile | Minor | datanode, performance | Todd Lipcon | Todd Lipcon
HDFS-2080 | Speed up DFS read path by lessening checksum overhead | Major | hdfs-client, performance | Todd Lipcon | Todd Lipcon
MAPREDUCE-3325 | Improvements to CapacityScheduler doc | Major | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3341 | Enhance logging of initalized queue limit values | Major | mrv2 | Anupam Seth | Anupam Seth
MAPREDUCE-3331 | Improvement to single node cluster setup documentation for 0.23 | Minor | mrv2 | Anupam Seth | Anupam Seth
MAPREDUCE-3169 | Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2 | Major | mrv1, mrv2, test | Todd Lipcon | Ahmed Radwan
MAPREDUCE-3415 | improve MiniMRYarnCluster & DistributedShell JAR resolution | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-2560 | Refactor BPOfferService to be a static inner class | Major | datanode | Todd Lipcon | Todd Lipcon
HDFS-2562 | Refactor DN configuration variables out of DataNode class | Minor | datanode | Todd Lipcon | Todd Lipcon
HDFS-2563 | Some cleanup in BPOfferService | Major | datanode | Todd Lipcon | Todd Lipcon
HDFS-2502 | hdfs-default.xml should include dfs.name.dir.restore | Minor | documentation | Eli Collins | Harsh J
HDFS-2568 | Use a set to manage child sockets in XceiverServer | Trivial | datanode | Harsh J | Harsh J
HDFS-2454 | Move maxXceiverCount check to before starting the thread in dataXceiver | Minor | datanode | Uma Maheswara Rao G | Harsh J
HDFS-2570 | Add descriptions for dfs.*.https.address in hdfs-default.xml | Trivial | documentation | Eli Collins | Eli Collins
HADOOP-7841 | Run tests with non-secure random | Trivial | build | Todd Lipcon | Todd Lipcon
HADOOP-6614 | RunJar should provide more diags when it can’t create a temp file | Minor | util | Steve Loughran | Jonathan Hsieh
HDFS-2566 | Move BPOfferService to be a non-inner class | Minor | datanode | Todd Lipcon | Todd Lipcon
HDFS-2536 | Remove unused imports | Trivial | namenode | Aaron T. Myers | Harsh J
MAPREDUCE-3411 | Performance Upgrade for jQuery | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-3265 | Reduce log level on MR2 IPC construction, etc | Blocker | mrv2 | Todd Lipcon | Arun C Murthy
HDFS-2246 | Shortcut a local client reads to a Datanodes files directly | Major | . | Sanjay Radia | Jitendra Nath Pandey
HADOOP-7858 | Drop some info logging to DEBUG level in IPC, metrics, and HTTP | Trivial | . | Todd Lipcon | Todd Lipcon
MAPREDUCE-3371 | Review and improve the yarn-api javadocs. | Minor | documentation, mrv2 | Ravi Prakash | Ravi Prakash
MAPREDUCE-3238 | Small cleanup in SchedulerApp | Trivial | mrv2 | Todd Lipcon | Todd Lipcon
HADOOP-7804 | enable hadoop config generator to set dfs.block.local-path-access.user to enable short circuit read | Major | conf | Arpit Gupta | Arpit Gupta
HADOOP-7777 | Implement a base class for DNSToSwitchMapping implementations that can offer extra topology information | Major | util | Steve Loughran | Steve Loughran
HDFS-2604 | Add a log message to show if WebHDFS is enabled | Minor | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-3369 | Migrate MR1 tests to run on MR2 using the new interfaces introduced in MAPREDUCE-3169 | Major | mrv1, mrv2, test | Ahmed Radwan | Ahmed Radwan
MAPREDUCE-3147 | Handle leaf queues with the same name properly | Major | mrv2 | Ravi Prakash | Ravi Prakash
HDFS-2178 | HttpFS - a read/write Hadoop file system proxy | Major | . | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-7758 | Make GlobFilter class public | Major | fs | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-6886 | LocalFileSystem Needs createNonRecursive API | Minor | fs | Nicolas Spiegelberg | Nicolas Spiegelberg
HDFS-2511 | Add dev script to generate HDFS protobufs | Minor | build | Todd Lipcon | Alejandro Abdelnur
HDFS-2653 | DFSClient should cache whether addrs are non-local when short-circuiting is enabled | Major | datanode | Eli Collins | Eli Collins
HDFS-2654 | Make BlockReaderLocal not extend RemoteBlockReader2 | Major | datanode | Eli Collins | Eli Collins
MAPREDUCE-2863 | Support web-services for RM & NM | Blocker | mrv2, nodemanager, resourcemanager | Arun C Murthy | Thomas Graves
HDFS-2675 | Reduce verbosity when double-closing edit logs | Trivial | namenode | Todd Lipcon | Todd Lipcon
HADOOP-7657 | Add support for LZ4 compression | Major | . | Bert Sanders | Binglin Chang
HDFS-2335 | DataNodeCluster and NNStorage always pull fresh entropy | Major | datanode, namenode | Eli Collins | Uma Maheswara Rao G
HADOOP-7890 | Redirect hadoop script’s deprecation message to stderr | Trivial | scripts | Koji Noguchi | Koji Noguchi
MAPREDUCE-3597 | Provide a way to access other info of history file from Rumentool | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi
HADOOP-7574 | Improvement for FSshell -stat | Trivial | fs | XieXianshan | XieXianshan
HADOOP-6840 | Support non-recursive create() in FileSystem & SequenceFile.Writer | Minor | fs, io | Nicolas Spiegelberg | Nicolas Spiegelberg
HDFS-2726 | “Exception in createBlockOutputStream” shouldn’t delete exception stack trace | Major | . | Michael Bieniosek | Harsh J
HADOOP-7910 | add configuration methods to handle human readable size values | Minor | conf | Sho Shimauchi | Sho Shimauchi
HDFS-2729 | Update BlockManager’s comments regarding the invalid block set | Minor | namenode | Harsh J | Harsh J
HDFS-554 | BlockInfo.ensureCapacity may get a speedup from System.arraycopy() | Minor | namenode | Steve Loughran | Harsh J
HADOOP-7919 | [Doc] Remove hadoop.logfile.* properties. | Trivial | documentation | Harsh J | Harsh J
HADOOP-7504 | hadoop-metrics.properties missing some Ganglia31 options | Trivial | metrics | Eli Collins | Harsh J
MAPREDUCE-3610 | Some parts in MR use old property dfs.block.size | Minor | . | Sho Shimauchi | Sho Shimauchi
HADOOP-7934 | Normalize dependencies versions across all modules | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-4515 | conf.getBoolean must be case insensitive | Minor | . | Abhijit Bagri | Sho Shimauchi
MAPREDUCE-3299 | Add AMInfo table to the AM job page | Minor | mrv2 | Siddharth Seth | Jonathan Eagles
HDFS-2788 | HdfsServerConstants#DN_KEEPALIVE_TIMEOUT is dead code | Major | datanode | Eli Collins | Eli Collins
HDFS-2803 | Adding logging to LeaseRenewer for better lease expiration triage. | Minor | namenode | Jimmy Xiang | Jimmy Xiang
HDFS-2817 | Combine the two TestSafeMode test suites | Minor | test | Todd Lipcon | Todd Lipcon
HDFS-2825 | Add test hook to turn off the writer preferring its local DN | Minor | namenode | Todd Lipcon | Todd Lipcon
HDFS-2826 | Test case for HDFS-1476 (safemode can initialize repl queues before exiting) | Minor | namenode, test | Todd Lipcon | Todd Lipcon
HDFS-2397 | Undeprecate SecondaryNameNode | Major | namenode | Todd Lipcon | Eli Collins
MAPREDUCE-3692 | yarn-resourcemanager out and log files can get big | Blocker | mrv2 | Eli Collins | Eli Collins
HADOOP-7987 | Support setting the run-as user in unsecure mode | Major | security | Devaraj Das | Jitendra Nath Pandey
MAPREDUCE-3360 | Provide information about lost nodes in the UI. | Critical | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh
MAPREDUCE-3693 | Add admin env to mapred-default.xml | Minor | mrv2 | Roman Shaposhnik | Roman Shaposhnik
HADOOP-7939 | Improve Hadoop subcomponent integration in Hadoop 0.23 | Major | build, conf, documentation, scripts | Roman Shaposhnik | Roman Shaposhnik
MAPREDUCE-3481 | [Gridmix] Improve STRESS mode locking | Major | contrib/gridmix | Amar Kamat | Amar Kamat
MAPREDUCE-3679 | AM logs and others should not automatically refresh after every 1 second. | Major | mrv2 | Mahadev konar | Vinod Kumar Vavilapalli
MAPREDUCE-3756 | Make single shuffle limit configurable | Major | mrv2 | Arun C Murthy | Hitesh Shah
MAPREDUCE-3771 | Port MAPREDUCE-1735 to trunk/0.23 | Major | . | Arun C Murthy | Arun C Murthy
HADOOP-8015 | ChRootFileSystem should extend FilterFileSystem | Major | fs | Daryn Sharp | Daryn Sharp
HDFS-2814 | NamenodeMXBean does not account for svn revision in the version information | Minor | . | Hitesh Shah | Hitesh Shah
HDFS-2868 | Add number of active transfer threads to the DataNode status | Minor | datanode | Harsh J | Harsh J
HADOOP-8027 | Visiting /jmx on the daemon web interfaces may print unnecessary error in logs | Minor | metrics | Harsh J | Aaron T. Myers
HADOOP-8009 | Create hadoop-client and hadoop-minicluster artifacts for downstream projects | Critical | build | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3139 | Minor Datanode logging improvement | Minor | datanode | Eli Collins | Eli Collins
HDFS-2761 | Improve Hadoop subcomponent integration in Hadoop 0.23 | Major | build, hdfs-client, scripts | Roman Shaposhnik | Roman Shaposhnik

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-2784 | [Gridmix] TestGridmixSummary fails with NPE when run in DEBUG mode. | Major | contrib/gridmix | Amar Kamat | Amar Kamat
MAPREDUCE-2950 | [Gridmix] TestUserResolve fails in trunk | Major | contrib/gridmix | Amar Kamat | Ravi Gummadi
HADOOP-6490 | Path.normalize should use StringUtils.replace in favor of String.replace | Minor | fs | Zheng Shao | Uma Maheswara Rao G
MAPREDUCE-3291 | App fail to launch due to delegation token not found in cache | Blocker | mrv2 | Ramya Sunil | Robert Joseph Evans
MAPREDUCE-3344 | o.a.h.mapreduce.Reducer since 0.21 blindly casts to ReduceContext.ValueIterator | Major | . | Brock Noland | Brock Noland
HADOOP-7801 | HADOOP_PREFIX cannot be overriden | Major | build | Bruno Mahé | Bruno Mahé
MAPREDUCE-3346 | Rumen LoggedTaskAttempt getHostName call returns hostname as null | Blocker | tools/rumen | Karam Singh | Amar Kamat
MAPREDUCE-3342 | JobHistoryServer doesn’t show job queue | Critical | jobhistoryserver, mrv2 | Thomas Graves | Jonathan Eagles
MAPREDUCE-3345 | Race condition in ResourceManager causing TestContainerManagerSecurity to fail sometimes | Major | mrv2, resourcemanager | Vinod Kumar Vavilapalli | Hitesh Shah
MAPREDUCE-3368 | compile-mapred-test fails | Critical | build, mrv2 | Ramya Sunil | Hitesh Shah
MAPREDUCE-3336 | com.google.inject.internal.Preconditions not public api - shouldn’t be using it | Critical | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3333 | MR AM for sort-job going out of memory | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3280 | MR AM should not read the username from configuration | Major | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3379 | LocalResourceTracker should not tracking deleted cache entries | Major | mrv2, nodemanager | Siddharth Seth | Siddharth Seth
MAPREDUCE-3370 | MiniMRYarnCluster uses a hard coded path location for the MapReduce application jar | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan
HADOOP-7813 | test-patch +1 patches that introduce javadoc and findbugs warnings in some cases | Major | build, test | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-3324 | Not All HttpServer tools links (stacks,logs,config,metrics) are accessible through all UI servers | Critical | jobhistoryserver, mrv2, nodemanager | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-3243 | Invalid tracking URL for streaming jobs | Major | contrib/streaming, mrv2 | Ramya Sunil | Jonathan Eagles
HADOOP-7811 | TestUserGroupInformation#testGetServerSideGroups test fails in chroot | Major | security, test | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-3355 | AM scheduling hangs frequently with sort job on 350 nodes | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3407 | Wrong jar getting used in TestMR*Jobs* for MiniMRYarnCluster | Minor | mrv2 | Hitesh Shah | Hitesh Shah
HADOOP-7787 | Make source tarball use conventional name. | Major | build | Bruno Mahé | Bruno Mahé
HADOOP-7802 | Hadoop scripts unconditionally source “$bin”/../libexec/hadoop-config.sh. | Major | . | Bruno Mahé | Bruno Mahé
HDFS-2544 | Hadoop scripts unconditionally source “$bin”/../libexec/hadoop-config.sh. | Major | scripts | Bruno Mahé | Bruno Mahé
MAPREDUCE-3373 | Hadoop scripts unconditionally source “$bin”/../libexec/hadoop-config.sh. | Major | . | Bruno Mahé | Bruno Mahé
HDFS-2543 | HADOOP_PREFIX cannot be overriden | Major | scripts | Bruno Mahé | Bruno Mahé
MAPREDUCE-3372 | HADOOP_PREFIX cannot be overriden | Major | . | Bruno Mahé | Bruno Mahé
HDFS-2541 | For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. | Major | datanode | Harsh J | Harsh J
HDFS-2567 | When 0 DNs are available, show a proper error when trying to browse DFS via web UI | Major | namenode | Harsh J | Harsh J
MAPREDUCE-3437 | Branch 23 fails to build with Failure to find org.apache.hadoop:hadoop-project:pom:0.24.0-SNAPSHOT | Blocker | build, mrv2 | Jonathan Eagles | Jonathan Eagles
HADOOP-7843 | compilation failing because workDir not initialized in RunJar.java | Major | . | John George | John George
MAPREDUCE-3434 | Nightly build broken | Blocker | mrv2 | Hitesh Shah | Hitesh Shah
HDFS-2575 | DFSTestUtil may create empty files | Minor | test | Todd Lipcon | Todd Lipcon
MAPREDUCE-3447 | mapreduce examples not working | Blocker | mrv2 | Thomas Graves | Mahadev konar
MAPREDUCE-3444 | trunk/0.23 builds broken | Blocker | mrv2 | Hitesh Shah | Hitesh Shah
MAPREDUCE-3412 | ‘ant docs’ is broken | Major | . | Amar Kamat | Amar Kamat
MAPREDUCE-3454 | [Gridmix] TestDistCacheEmulation is broken | Major | contrib/gridmix | Amar Kamat | Hitesh Shah
MAPREDUCE-3408 | yarn-daemon.sh unconditionnaly sets yarn.root.logger | Major | mrv2, nodemanager, resourcemanager | Bruno Mahé | Bruno Mahé
MAPREDUCE-3329 | capacity schedule maximum-capacity allowed to be less then capacity | Blocker | mrv2 | Thomas Graves | Arun C Murthy
HDFS-2588 | hdfs jsp pages missing DOCTYPE [post-split branches] | Trivial | scripts | Dave Vronay | Dave Vronay
MAPREDUCE-3464 | mapreduce jsp pages missing DOCTYPE [post-split branches] | Trivial | . | Dave Vronay | Dave Vronay
HDFS-2590 | Some links in WebHDFS forrest doc do not work | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-7859 | TestViewFsHdfs.testgetFileLinkStatus is failing an assert | Major | fs | Eli Collins | Eli Collins
MAPREDUCE-3413 | RM web ui applications not sorted in any order by default | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles
HDFS-2596 | TestDirectoryScanner doesn’t test parallel scans | Major | datanode, test | Eli Collins | Eli Collins
MAPREDUCE-3045 | Elapsed time filter on jobhistory server displays incorrect table entries | Minor | jobhistoryserver, mrv2 | Ramya Sunil | Jonathan Eagles
MAPREDUCE-3465 | org.apache.hadoop.yarn.util.TestLinuxResourceCalculatorPlugin fails on 0.23 | Minor | mrv2 | Hitesh Shah | Hitesh Shah
MAPREDUCE-3121 | DFIP aka ‘NodeManager should handle Disk-Failures In Place’ | Blocker | mrv2, nodemanager | Vinod Kumar Vavilapalli | Ravi Gummadi
MAPREDUCE-3448 | TestCombineOutputCollector javac unchecked warning on mocked generics | Minor | mrv2 | Jonathan Eagles | Jonathan Eagles
HADOOP-7864 | Building mvn site with Maven < 3.0.2 causes OOM errors | Major | build | Andrew Bayer | Andrew Bayer
HDFS-2606 | webhdfs client filesystem impl must set the content-type header for create/append | Critical | webhdfs | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-3450 | NM port info no longer available in JobHistory | Major | mr-am, mrv2 | Siddharth Seth | Siddharth Seth
HADOOP-7853 | multiple javax security configurations cause conflicts | Blocker | security | Daryn Sharp | Daryn Sharp
MAPREDUCE-3477 | Hadoop site documentation cannot be built anymore on trunk and branch-0.23 | Major | documentation, mrv2 | Bruno Mahé | Jonathan Eagles
MAPREDUCE-3488 | Streaming jobs are failing because the main class isnt set in the pom files. | Blocker | mrv2 | Mahadev konar | Mahadev konar
HADOOP-7870 | fix SequenceFile#createWriter with boolean createParent arg to respect createParent. | Major | . | Jonathan Hsieh | Jonathan Hsieh
HDFS-2614 | hadoop dist tarball is missing hdfs headers | Major | build | Bruno Mahé | Alejandro Abdelnur
HADOOP-7854 | UGI getCurrentUser is not synchronized | Critical | security | Daryn Sharp | Daryn Sharp
MAPREDUCE-3463 | Second AM fails to recover properly when first AM is killed with java.lang.IllegalArgumentException causing lost job | Blocker | applicationmaster, mrv2 | Karam Singh | Siddharth Seth
MAPREDUCE-3452 | fifoscheduler web ui page always shows 0% used for the queue | Major | mrv2 | Thomas Graves | Jonathan Eagles
MAPREDUCE-3443 | Oozie jobs are running as oozie user even though they create the jobclient as doAs. | Blocker | mrv2 | Mahadev konar | Mahadev konar
MAPREDUCE-3460 | MR AM can hang if containers are allocated on a node blacklisted by the AM | Blocker | mr-am, mrv2 | Siddharth Seth | Robert Joseph Evans
MAPREDUCE-3453 | RM web ui application details page shows RM cluster about information | Major | mrv2 | Thomas Graves | Jonathan Eagles
MAPREDUCE-3479 | JobClient#getJob cannot find local jobs | Major | client | Tom White | Tom White
MAPREDUCE-3500 | MRJobConfig creates an LD_LIBRARY_PATH using the platform ARCH | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-3456 | $HADOOP_PREFIX/bin/yarn should set defaults for $HADOOP_*_HOME | Blocker | mrv2 | Eric Payne | Eric Payne
MAPREDUCE-3458 | Fix findbugs warnings in hadoop-examples | Major | mrv2 | Arun C Murthy | Devaraj K
MAPREDUCE-3389 | MRApps loads the ‘mrapp-generated-classpath’ file with classpath from the build machine | Critical | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-3496 | Yarn initializes ACL operations from capacity scheduler config in a non-deterministic order | Major | mrv2 | Jonathan Eagles | Jonathan Eagles
HADOOP-7887 | KerberosAuthenticatorHandler is not setting KerberosName name rules from configuration | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-7898 | Fix javadoc warnings in AuthenticationToken.java | Minor | security | Suresh Srinivas | Suresh Srinivas
MAPREDUCE-3327 | RM web ui scheduler link doesn’t show correct max value for queues | Critical | mrv2 | Thomas Graves | Anupam Seth
MAPREDUCE-3513 | Capacity Scheduler web UI has a spelling mistake for Memory. | Trivial | mrv2 | Mahadev konar | chackaravarthy
HADOOP-7851 | Configuration.getClasses() never returns the default value. | Major | conf | Amar Kamat | Uma Maheswara Rao G
HDFS-2594 | webhdfs HTTP API should implement getDelegationTokens() instead getDelegationToken() | Critical | webhdfs | Alejandro Abdelnur | Tsz Wo Nicholas Sze
HADOOP-7902 | skipping name rules setting (if already set) should be done on UGI initialization only | Major | . | Tsz Wo Nicholas Sze | Alejandro Abdelnur
HADOOP-7878 | Regression HADOOP-7777 switch changes break HDFS tests when the isSingleSwitch() predicate is used | Minor | util | Steve Loughran | Steve Loughran
MAPREDUCE-3527 | Fix minor API incompatibilities between 1.0 and 0.23 | Major | . | Tom White | Tom White
HADOOP-7912 | test-patch should run eclipse:eclipse to verify that it does not break again | Major | build | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-3518 | mapred queue -info <queue> -showJobs throws NPE | Critical | client, mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-3328 | mapred queue -list output inconsistent and missing child queues | Critical | mrv2 | Thomas Graves | Ravi Prakash
MAPREDUCE-3510 | Capacity Scheduler inherited ACLs not displayed by mapred queue -showacls | Major | capacity-sched, mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-3537 | DefaultContainerExecutor has a race condn. with multiple concurrent containers | Blocker | . | Arun C Murthy | Arun C Murthy
HADOOP-7914 | duplicate declaration of hadoop-hdfs test-jar | Major | build | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-7810 | move hadoop archive to core from tools | Blocker | . | John George | John George
MAPREDUCE-3542 | Support “FileSystemCounter” legacy counter group name for compatibility | Major | . | Tom White | Tom White
MAPREDUCE-3544 | gridmix build is broken, requires hadoop-archives to be added as ivy dependency | Major | build, tools/rumen | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-2545 | Webhdfs: Support multiple namenodes in federation | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-2649 | eclipse:eclipse build fails for hadoop-hdfs-httpfs | Major | build | Jason Lowe | Jason Lowe
MAPREDUCE-3557 | MR1 test fail to compile because of missing hadoop-archives dependency | Major | build | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-3398 | Log Aggregation broken in Secure Mode | Blocker | mrv2, nodemanager | Siddharth Seth | Siddharth Seth
MAPREDUCE-3541 | Fix broken TestJobQueueClient test | Blocker | mrv2 | Ravi Prakash | Ravi Prakash
MAPREDUCE-3530 | Sometimes NODE_UPDATE to the scheduler throws an NPE causing the scheduling to stop | Blocker | mrv2, resourcemanager, scheduler | Karam Singh | Arun C Murthy
MAPREDUCE-3484 | JobEndNotifier is getting interrupted before completing all its retries. | Major | mr-am, mrv2 | Ravi Prakash | Ravi Prakash
MAPREDUCE-3531 | Sometimes java.lang.IllegalArgumentException: Invalid key to HMAC computation in NODE_UPDATE also causing RM to stop scheduling | Blocker | mrv2, resourcemanager, scheduler | Karam Singh | Robert Joseph Evans
MAPREDUCE-3560 | TestRMNodeTransitions is failing on trunk | Blocker | mrv2, resourcemanager, test | Vinod Kumar Vavilapalli | Siddharth Seth
HADOOP-7917 | compilation of protobuf files fails in windows/cygwin | Major | build | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-3487 | jobhistory web ui task counters no longer links to singletakecounter page | Critical | mrv2 | Thomas Graves | Jason Lowe
MAPREDUCE-3564 | TestStagingCleanup and TestJobEndNotifier are failing on trunk. | Blocker | mrv2 | Mahadev konar | Siddharth Seth
MAPREDUCE-3422 | Counter display names are not being picked up | Major | mrv2 | Tom White | Jonathan Eagles
MAPREDUCE-3366 | Mapreduce component should use consistent directory structure layout as HDFS/common | Major | mrv2 | Eric Yang | Eric Yang
MAPREDUCE-3387 | A tracking URL of N/A before the app master is launched breaks oozie | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans
HDFS-2640 | Javadoc generation hangs | Major | . | Tom White | Tom White
MAPREDUCE-3579 | ConverterUtils should not include a port in a path for a URL with no port | Major | mrv2 | Aaron T. Myers | Aaron T. Myers
HDFS-2553 | BlockPoolSliceScanner spinning in loop | Critical | datanode | Todd Lipcon | Uma Maheswara Rao G
HDFS-2658 | HttpFS introduced 70 javadoc warnings | Major | . | Eli Collins | Alejandro Abdelnur
MAPREDUCE-3563 | LocalJobRunner doesn’t handle Jobs using o.a.h.mapreduce.OutputCommitter | Major | mrv2 | Arun C Murthy | Arun C Murthy
HDFS-2706 | Use configuration for blockInvalidateLimit if it is set | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-7837 | no NullAppender in the log4j config | Major | conf | Steve Loughran | Eli Collins
MAPREDUCE-3376 | Old mapred API combiner uses NULL reporter | Major | mrv1, mrv2 | Robert Joseph Evans | Subroto Sanyal
MAPREDUCE-3391 | Connecting to CM is logged as Connecting to RM | Minor | applicationmaster | Subroto Sanyal | Subroto Sanyal
MAPREDUCE-3339 | Job is getting hanged indefinitely,if the child processes are killed on the NM. KILL_CONTAINER eventtype is continuosly sent to the containers that are not existing | Blocker | mrv2 | Ramgopal N | Siddharth Seth
MAPREDUCE-3588 | bin/yarn broken after MAPREDUCE-3366 | Blocker | . | Arun C Murthy | Arun C Murthy
HDFS-2646 | Hadoop HttpFS introduced 4 findbug warnings. | Major | . | Uma Maheswara Rao G | Alejandro Abdelnur
HDFS-2657 | TestHttpFSServer and TestServerWebApp are failing on trunk | Major | . | Eli Collins | Alejandro Abdelnur
MAPREDUCE-3349 | No rack-name logged in JobHistory for unsuccessful tasks | Blocker | mrv2 | Vinod Kumar Vavilapalli | Amar Kamat
HDFS-2705 | HttpFS server should check that upload requests have correct content-type | Major | . | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-3586 | Lots of AMs hanging around in PIG testing | Blocker | mr-am, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
HDFS-2707 | HttpFS should read the hadoop-auth secret from a file instead inline from the configuration | Major | security | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-3604 | Streaming’s check for local mode is broken | Blocker | contrib/streaming | Arun C Murthy | Arun C Murthy
MAPREDUCE-3521 | Hadoop Streaming ignores unknown parameters | Minor | mrv2 | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-3522 | Capacity Scheduler ACLs not inherited by default | Major | mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-3608 | MAPREDUCE-3522 commit causes compilation to fail | Major | mrv2 | Mahadev konar | Mahadev konar
HDFS-2722 | HttpFs shouldn’t be using an int for block size | Major | hdfs-client | Harsh J | Harsh J
HADOOP-7933 | Viewfs changes for MAPREDUCE-3529 | Critical | viewfs | Siddharth Seth | Siddharth Seth
MAPREDUCE-3462 | Job submission failing in JUnit tests | Blocker | mrv2, test | Amar Kamat | Ravi Prakash
HDFS-1314 | dfs.blocksize accepts only absolute value | Minor | . | Karim Saadah | Sho Shimauchi
MAPREDUCE-3490 | RMContainerAllocator counts failed maps towards Reduce ramp up | Blocker | mr-am, mrv2 | Siddharth Seth | Sharad Agarwal
HADOOP-7948 | Shell scripts created by hadoop-dist/pom.xml to build tar do not properly propagate failure | Minor | build | Michajlo Matijkiw | Michajlo Matijkiw
MAPREDUCE-1744 | DistributedCache creates its own FileSytem instance when adding a file/archive to the path | Major | . | Dick King | Dick King
MAPREDUCE-3529 | TokenCache does not cache viewfs credentials correctly | Critical | mrv2 | Siddharth Seth | Siddharth Seth
MAPREDUCE-3478 | Cannot build against ZooKeeper 3.4.0 | Minor | mrv2 | Andrew Bayer | Tom White
HADOOP-7949 | Updated maxIdleTime default in the code to match core-default.xml | Trivial | ipc | Eli Collins | Eli Collins
MAPREDUCE-3615 | mapred ant test failures | Blocker | mrv2 | Thomas Graves | Thomas Graves
HDFS-2710 | HDFS part of MAPREDUCE-3529, HADOOP-7933 | Critical | . | Siddharth Seth |
MAPREDUCE-3326 | RM web UI scheduler link not as useful as should be | Critical | mrv2 | Thomas Graves | Jason Lowe
MAPREDUCE-3617 | Remove yarn default values for resource manager and nodemanager principal | Major | mrv2 | Jonathan Eagles | Jonathan Eagles
HADOOP-7907 | hadoop-tools JARs are not part of the distro | Blocker | build | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-7936 | There’s a Hoop README in the root dir of the tarball | Major | build | Eli Collins | Alejandro Abdelnur
MAPREDUCE-3624 | bin/yarn script adds jdk tools.jar to the classpath. | Major | mrv2 | Mahadev konar | Mahadev konar
HADOOP-7963 | test failures: TestViewFileSystemWithAuthorityLocalFileSystem and TestViewFileSystemLocalFileSystem | Blocker | . | Thomas Graves | Siddharth Seth
MAPREDUCE-3528 | The task timeout check interval should be configurable independent of mapreduce.task.timeout | Major | mr-am, mrv2 | Siddharth Seth | Siddharth Seth
MAPREDUCE-3639 | TokenCache likely broken for FileSystems which don’t issue delegation tokens | Blocker | mrv2 | Siddharth Seth | Siddharth Seth
MAPREDUCE-3420 | [Umbrella ticket] Make uber jobs functional | Major | mrv2 | Hitesh Shah |
MAPREDUCE-3312 | Make MR AM not send a stopContainer w/o corresponding start container | Major | mrv2 | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-3382 | Network ACLs can prevent AMs to ping the Job-end notification URL | Critical | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Ravi Prakash
MAPREDUCE-3648 | TestJobConf failing | Blocker | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3651 | TestQueueManagerRefresh fails | Blocker | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3645 | TestJobHistory fails | Blocker | mrv1 | Thomas Graves | Thomas Graves
MAPREDUCE-3652 | org.apache.hadoop.mapred.TestWebUIAuthorization.testWebUIAuthorization fails | Blocker | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3625 | CapacityScheduler web-ui display of queue’s used capacity is broken | Critical | mrv2 | Arun C Murthy | Jason Lowe
HDFS-69 | Improve dfsadmin command line help | Minor | . | Ravi Phulari | Harsh J
MAPREDUCE-3596 | Sort benchmark got hang after completion of 99% map phase | Blocker | applicationmaster, mrv2 | Ravi Prakash | Vinod Kumar Vavilapalli
MAPREDUCE-3656 | Sort job on 350 scale is consistently failing with latest MRV2 code | Blocker | applicationmaster, mrv2, resourcemanager | Karam Singh | Siddharth Seth
MAPREDUCE-3532 | When 0 is provided as port number in yarn.nodemanager.webapp.address, NMs webserver component picks up random port, NM keeps on Reporting 0 port to RM | Critical | mrv2, nodemanager | Karam Singh | Bhallamudi Venkata Siva Kamesh
MAPREDUCE-3404 | Speculative Execution: speculative map tasks launched even if -Dmapreduce.map.speculative=false | Critical | job submission, mrv2 | patrick white | Eric Payne
HDFS-2790 | FSNamesystem.setTimes throws exception with wrong configuration name in the message | Minor | . | Arpit Gupta | Arpit Gupta
HADOOP-7975 | Add entry to XML defaults for new LZ4 codec | Minor | . | Harsh J | Harsh J
MAPREDUCE-3649 | Job End notification gives an error on calling back. | Blocker | mrv2 | Mahadev konar | Ravi Prakash
MAPREDUCE-3657 | State machine visualize build fails | Minor | build, mrv2 | Jason Lowe | Jason Lowe
MAPREDUCE-3664 | HDFS Federation Documentation has incorrect configuration example | Minor | documentation | praveen sripati | Brandon Li
MAPREDUCE-2450 | Calls from running tasks to TaskTracker methods sometimes fail and incur a 60s timeout | Major | . | Matei Zaharia | Rajesh Balamohan
HADOOP-7971 | hadoop <job/queue/pipes> removed - should be added back, but deprecated | Blocker | . | Thomas Graves | Prashant Sharma
MAPREDUCE-3669 | Getting a lot of PriviledgedActionException / SaslException when running a job | Blocker | mrv2 | Thomas Graves | Mahadev konar
MAPREDUCE-3684 | LocalDistributedCacheManager does not shut down its thread pool | Major | client | Tom White | Tom White
HADOOP-7982 | UserGroupInformation fails to login if thread’s context classloader can’t load HadoopLoginModule | Major | security | Todd Lipcon | Todd Lipcon
HDFS-2810 | Leases not properly getting renewed by clients | Critical | hdfs-client | Todd Lipcon | Todd Lipcon
HDFS-2751 | Datanode drops OS cache behind reads even for short reads | Major | datanode | Todd Lipcon | Todd Lipcon
HADOOP-7986 | Add config for History Server protocol in hadoop-policy for service level authorization. | Major | . | Mahadev konar | Mahadev konar
MAPREDUCE-3582 | Move successfully passing MR1 tests to MR2 maven tree. | Major | mrv2, test | Ahmed Radwan | Ahmed Radwan
HDFS-2816 | Fix missing license header in hadoop-hdfs-project/hadoop-hdfs-httpfs/dev-support/findbugsExcludeFile.xml | Trivial | . | Hitesh Shah | Hitesh Shah
MAPREDUCE-3689 | RM web UI doesn’t handle newline in job name | Blocker | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3701 | Delete HadoopYarnRPC from 0.23 branch. | Major | mrv2 | Mahadev konar | Mahadev konar
MAPREDUCE-3549 | write api documentation for web service apis for RM, NM, mapreduce app master, and job history server | Blocker | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3705 | ant build fails on 0.23 branch | Blocker | mrv2 | Thomas Graves | Thomas Graves
HDFS-2818 | dfshealth.jsp missing space between role and node name | Trivial | namenode | Todd Lipcon | Devaraj K
HDFS-2822 | processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated | Major | ha, namenode | Todd Lipcon | Todd Lipcon
MAPREDUCE-3702 | internal server error trying access application master via proxy with filter enabled | Critical | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3691 | webservices add support to compress response | Critical | mrv2 | Thomas Graves | Thomas Graves
HADOOP-7981 | Improve documentation for org.apache.hadoop.io.compress.Decompressor.getRemaining | Major | io | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-3646 | Remove redundant URL info from “mapred job” output | Major | client, mrv2 | Ramya Sunil | Jonathan Eagles
MAPREDUCE-3681 | capacity scheduler LeafQueues calculate used capacity wrong | Critical | mrv2 | Thomas Graves | Arun C Murthy
HADOOP-7964 | Deadlock in class init. | Blocker | security, util | Kihwal Lee | Daryn Sharp
HDFS-442 | dfsthroughput in test.jar throws NPE | Minor | test | Ramya Sunil | Harsh J
MAPREDUCE-3505 | yarn APPLICATION_CLASSPATH needs to be overridable | Major | mrv2 | Bruno Mahé | Ahmed Radwan
MAPREDUCE-3710 | last split generated by FileInputFormat.getSplits may not have the best locality | Major | mrv1, mrv2 | Siddharth Seth | Siddharth Seth
MAPREDUCE-3714 | Reduce hangs in a corner case | Blocker | mrv2, task | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3712 | The mapreduce tar does not contain the hadoop-mapreduce-client-jobclient-tests.jar. | Blocker | mrv2 | Ravi Prakash | Mahadev konar
MAPREDUCE-3717 | JobClient test jar has missing files to run all the test programs. | Blocker | mrv2 | Mahadev konar | Mahadev konar
MAPREDUCE-3683 | Capacity scheduler LeafQueues maximum capacity calculation issues | Blocker | mrv2 | Thomas Graves | Arun C Murthy
MAPREDUCE-3194 | “mapred mradmin” command is broken in mrv2 | Major | mrv2 | Siddharth Seth | Jason Lowe
MAPREDUCE-3713 | Incorrect headroom reported to jobs | Blocker | mrv2, resourcemanager | Siddharth Seth | Arun C Murthy
MAPREDUCE-3721 | Race in shuffle can cause it to hang | Blocker | mrv2 | Siddharth Seth | Siddharth Seth
MAPREDUCE-3733 | Add Apache License Header to hadoop-distcp/pom.xml | Major | . | Mahadev konar | Mahadev konar
HDFS-2836 | HttpFSServer still has 2 javadoc warnings in trunk | Major | . | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-3735 | Add distcp jar to the distribution (tar) | Blocker | mrv2 | Mahadev konar | Mahadev konar
HDFS-2837 | mvn javadoc:javadoc not seeing LimitedPrivate class | Major | . | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-3737 | The Web Application Proxy’s is not documented very well | Critical | mrv2 | Robert Joseph Evans | Robert Joseph Evans
MAPREDUCE-3699 | Default RPC handlers are very low for YARN servers | Major | mrv2 | Vinod Kumar Vavilapalli | Hitesh Shah
HADOOP-7993 | Hadoop ignores old-style config options for enabling compressed output | Major | conf | Anupam Seth | Anupam Seth
MAPREDUCE-3742 | “yarn logs” command fails with ClassNotFoundException | Blocker | mrv2 | Jason Lowe | Jason Lowe
HADOOP-7998 | CheckFileSystem does not correctly honor setVerifyChecksum | Major | fs | Daryn Sharp | Daryn Sharp
HADOOP-8000 | fetchdt command not available in bin/hadoop | Critical | . | Arpit Gupta | Arpit Gupta
HDFS-2840 | TestHostnameFilter should work with localhost or localhost.localdomain | Major | test | Eli Collins | Alejandro Abdelnur
HDFS-2791 | If block report races with closing of file, replica is incorrectly marked corrupt | Major | datanode, namenode | Todd Lipcon | Todd Lipcon
MAPREDUCE-3732 | CS should only use ‘activeUsers with pending requests’ for computing user-limits | Blocker | mrv2, resourcemanager, scheduler | Arun C Murthy | Arun C Murthy
HADOOP-7988 | Upper case in hostname part of the principals doesn’t work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey
HADOOP-8002 | SecurityUtil acquired token message should be a debug rather than info | Major | . | Arpit Gupta | Arpit Gupta
HADOOP-7999 | “hadoop archive” fails with ClassNotFoundException | Critical | scripts | Jason Lowe | Jason Lowe
MAPREDUCE-3703 | ResourceManager should provide node lists in JMX output | Critical | mrv2, resourcemanager | Eric Payne | Eric Payne
MAPREDUCE-3716 | java.io.File.createTempFile fails in map/reduce tasks | Blocker | mrv2 | Jonathan Eagles | Jonathan Eagles
MAPREDUCE-3748 | Move CS related nodeUpdate log messages to DEBUG | Minor | mrv2 | Ramya Sunil | Ramya Sunil
MAPREDUCE-3764 | AllocatedGB etc metrics incorrect if min-allocation-mb isn’t a multiple of 1GB | Critical | mrv2 | Siddharth Seth | Arun C Murthy
MAPREDUCE-3749 | ConcurrentModificationException in counter groups | Blocker | mrv2 | Tom White | Tom White
HDFS-2835 | Fix org.apache.hadoop.hdfs.tools.GetConf$Command Findbug issue | Major | tools | Robert Joseph Evans | Robert Joseph Evans
HADOOP-8006 | TestFSInputChecker is failing in trunk. | Major | fs | Uma Maheswara Rao G | Daryn Sharp
MAPREDUCE-3754 | RM webapp should have pages filtered based on App-state | Major | mrv2, webapps | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3762 | Resource Manager fails to come up with default capacity scheduler configs. | Critical | mrv2 | Mahadev konar | Mahadev konar
MAPREDUCE-3499 | New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not work | Blocker | mrv2, test | Alejandro Abdelnur | John George
MAPREDUCE-3774 | yarn-default.xml should be moved to hadoop-yarn-common. | Major | mrv2 | Mahadev konar | Mahadev konar
MAPREDUCE-3696 | MR job via oozie does not work on hadoop 23 | Blocker | mrv2 | John George | John George
MAPREDUCE-3427 | streaming tests fail with MR2 | Blocker | contrib/streaming, mrv2 | Alejandro Abdelnur | Hitesh Shah
MAPREDUCE-3752 | Headroom should be capped by queue max-cap | Blocker | mrv2 | Arun C Murthy | Arun C Murthy
MAPREDUCE-3744 | Unable to retrieve application logs via “yarn logs” or “mapred job -logs” | Blocker | mrv2 | Jason Lowe | Jason Lowe
MAPREDUCE-3780 | RM assigns containers to killed applications | Blocker | mrv2 | Ramya Sunil | Hitesh Shah
HDFS-2827 | Cannot save namespace after renaming a directory above a file with an open lease | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G
HADOOP-8001 | ChecksumFileSystem’s rename doesn’t correctly handle checksum files | Major | fs | Daryn Sharp | Daryn Sharp
MAPREDUCE-3708 | Metrics: Incorrect Apps Submitted Count | Major | mrv2 | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh
MAPREDUCE-3784 | maxActiveApplications(|PerUser) per queue is too low for small clusters | Major | mrv2 | Ramya Sunil | Arun C Murthy
HADOOP-8018 | Hudson auto test for HDFS has started throwing javadoc: warning - Error fetching URL: http://java.sun.com/javase/6/docs/api/package-list | Major | build, test | Matt Foley | Jonathan Eagles
HDFS-2889 | getNumCurrentReplicas is package private but should be public on 0.23 (see HDFS-2408) | Major | hdfs-client | Gregory Chanan | Gregory Chanan
MAPREDUCE-3760 | Blacklisted NMs should not appear in Active nodes list | Major | mrv2 | Ramya Sunil | Vinod Kumar Vavilapalli
MAPREDUCE-3417 | job access controls not working app master and job history UI’s | Blocker | mrv2 | Thomas Graves | Jonathan Eagles
MAPREDUCE-3791 | can’t build site in hadoop-yarn-server-common | Major | documentation, mrv2 | Roman Shaposhnik | Mahadev konar
MAPREDUCE-3723 | TestAMWebServicesJobs & TestHSWebServicesJobs incorrectly asserting tests | Major | mrv2, test, webapps | Bhallamudi Venkata Siva Kamesh | Bhallamudi Venkata Siva Kamesh
MAPREDUCE-3795 | “job -status” command line output is malformed | Major | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3759 | ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodes | Major | mrv2 | Ramya Sunil | Vinod Kumar Vavilapalli
MAPREDUCE-3775 | Change MiniYarnCluster to escape special chars in testname | Minor | mrv2 | Hitesh Shah | Hitesh Shah
MAPREDUCE-3765 | FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb setting | Minor | mrv2 | Hitesh Shah | Hitesh Shah
MAPREDUCE-3747 | Memory Total is not refreshed until an app is launched | Major | mrv2 | Ramya Sunil | Arun C Murthy
HDFS-2893 | The start/stop scripts don’t start/stop the 2NN when using the default configuration | Minor | . | Eli Collins | Eli Collins
MAPREDUCE-3814 | MR1 compile fails | Major | mrv1, mrv2 | Arun C Murthy | Arun C Murthy
MAPREDUCE-3808 | NPE in FileOutputCommitter when running a 0 reduce job | Blocker | mrv2 | Siddharth Seth | Robert Joseph Evans
MAPREDUCE-3804 | yarn webapp interface vulnerable to cross scripting attacks | Major | jobhistoryserver, mrv2, resourcemanager | Dave Thompson | Dave Thompson
MAPREDUCE-3354 | JobHistoryServer should be started by bin/mapred and not by bin/yarn | Blocker | jobhistoryserver, mrv2 | Vinod Kumar Vavilapalli | Jonathan Eagles
MAPREDUCE-3794 | Support mapred.Task.Counter and mapred.JobInProgress.Counter enums for compatibility | Major | mrv2 | Tom White | Tom White
MAPREDUCE-3697 | Hadoop Counters API limits Oozie’s working across different hadoop versions | Blocker | mrv2 | John George | Mahadev konar
MAPREDUCE-3817 | bin/mapred command cannot run distcp and archive jobs | Major | mrv2 | Arpit Gupta | Arpit Gupta
MAPREDUCE-3709 | TestDistributedShell is failing | Major | mrv2, test | Eli Collins | Hitesh Shah
MAPREDUCE-3436 | JobHistory webapp address should use the host from the jobhistory address | Major | mrv2, webapps | Bruno Mahé | Ahmed Radwan
MAPREDUCE-3833 | Capacity scheduler queue refresh doesn’t recompute queue capacities properly | Major | mrv2 | Jason Lowe | Jason Lowe
MAPREDUCE-3826 | RM UI when loaded throws a message stating Data Tables warning and then the column sorting stops working | Major | mrv2 | Arpit Gupta | Jonathan Eagles
MAPREDUCE-3822 | TestJobCounters is failing intermittently on trunk and 0.23. | Critical | mrv2 | Mahadev konar | Mahadev konar
MAPREDUCE-3834 | If multiple hosts for a split belong to the same rack, the rack is added multiple times in the AM request table | Critical | mr-am, mrv2 | Siddharth Seth | Siddharth Seth
HADOOP-7974 | TestViewFsTrash incorrectly determines the user’s home directory | Major | fs, test | Eli Collins | Harsh J
HADOOP-8012 | hadoop-daemon.sh and yarn-daemon.sh are trying to mkdir and chow log/pid dirs which can fail | Minor | scripts | Roman Shaposhnik | Roman Shaposhnik
MAPREDUCE-3828 | Broken urls: AM tracking url and jobhistory url in a single node setup. | Major | mrv2 | Ahmed Radwan | Siddharth Seth
MAPREDUCE-3770 | [Rumen] Zombie.getJobConf() results into NPE | Critical | tools/rumen | Amar Kamat | Amar Kamat
HDFS-2923 | Namenode IPC handler count uses the wrong configuration key | Critical | namenode | Todd Lipcon | Todd Lipcon
MAPREDUCE-3840 | JobEndNotifier doesn’t use the proxyToUse during connecting | Blocker | mrv2 | Ravi Prakash | Ravi Prakash
MAPREDUCE-3843 | Job summary log file found missing on the RM host | Critical | jobhistoryserver, mrv2 | Anupam Seth | Anupam Seth
HADOOP-8055 | Distribution tar.gz does not contain etc/hadoop/core-site.xml | Major | build | Eric Charles | Harsh J
HDFS-2869 | Error in Webhdfs documentation for mkdir | Minor | webhdfs | Harsh J | Harsh J
HADOOP-8052 | Hadoop Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid making Ganglia’s gmetad core | Major | metrics | Varun Kapoor | Varun Kapoor
MAPREDUCE-3858 | Task attempt failure during commit results in task never completing | Critical | mrv2 | Tom White | Tom White
MAPREDUCE-3856 | Instances of RunningJob class givs incorrect job tracking urls when mutiple jobs are submitted from same client jvm. | Critical | mrv2 | Eric Payne | Eric Payne
HADOOP-8054 | NPE with FilterFileSystem | Critical | fs | Amareshwari Sriramadasu | Daryn Sharp
MAPREDUCE-3880 | Allow for 32-bit container-executor | Blocker | build, mrv2 | Arun C Murthy | Arun C Murthy
MAPREDUCE-3727 | jobtoken location property in jobconf refers to wrong jobtoken file | Critical | security | Alejandro Abdelnur | Alejandro Abdelnur

### TESTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-3595 | Add missing TestCounters#testCounterValue test from branch 1 to 0.23 | Major | test | Tom White | Tom White
MAPREDUCE-3803 | HDFS-2864 broke ant compilation | Major | build | Ravi Prakash | Ravi Prakash
MAPREDUCE-3854 | Reinstate environment variable tests in TestMiniMRChildTask | Major | mrv2 | Tom White | Tom White

### SUB-TASKS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-2130 | Switch default checksum to CRC32C | Major | hdfs-client | Todd Lipcon | Todd Lipcon
HDFS-2129 | Simplify BlockReader to not inherit from FSInputChecker | Major | hdfs-client, performance | Todd Lipcon | Todd Lipcon
MAPREDUCE-3221 | ant test TestSubmitJob failing on trunk | Minor | mrv2, test | Hitesh Shah | Devaraj K
MAPREDUCE-3215 | org.apache.hadoop.mapreduce.TestNoJobSetupCleanup failing on trunk | Minor | mrv2 | Hitesh Shah | Hitesh Shah
MAPREDUCE-3219 | ant test TestDelegationToken failing on trunk | Minor | mrv2, test | Hitesh Shah | Hitesh Shah
MAPREDUCE-3217 | ant test TestAuditLogger fails on trunk | Minor | mrv2, test | Hitesh Shah | Devaraj K
MAPREDUCE-3392 | Cluster.getDelegationToken() throws NPE if client.getDelegationToken() returns null. | Blocker | . | John George | John George
MAPREDUCE-3102 | NodeManager should fail fast with wrong configuration or permissions for LinuxContainerExecutor | Major | mrv2, security | Vinod Kumar Vavilapalli | Hitesh Shah
HADOOP-7590 | Mavenize streaming and MR examples | Major | build | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-3433 | Finding counters by legacy group name returns empty counters | Major | client, mrv2 | Tom White | Tom White
MAPREDUCE-3485 | DISKS_FAILED -101 error code should be defined in same location as ABORTED_CONTAINER_EXIT_STATUS | Major | mrv2 | Hitesh Shah | Ravi Gummadi
MAPREDUCE-3519 | Deadlock in LocalDirsHandlerService and ShuffleHandler | Blocker | mrv2, nodemanager | Ravi Gummadi | Ravi Gummadi
MAPREDUCE-3426 | uber-jobs tried to write outputs into wrong dir | Blocker | mrv2 | Hitesh Shah | Hitesh Shah
MAPREDUCE-3567 | Extraneous JobConf objects in AM heap | Major | mr-am, mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3399 | ContainerLocalizer should request new resources after completing the current one | Blocker | mrv2, nodemanager | Siddharth Seth | Siddharth Seth
MAPREDUCE-3568 | Optimize Job’s progress calculations in MR AM | Critical | mr-am, mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3547 | finish unit tests for web services for RM and NM | Critical | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3566 | MR AM slows down due to repeatedly constructing ContainerLaunchContext | Critical | mr-am, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3572 | MR AM’s dispatcher is blocked by heartbeats to ResourceManager | Critical | mr-am, mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3569 | TaskAttemptListener holds a global lock for all task-updates | Critical | mr-am, mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3548 | write unit tests for web services for mapreduce app master and job history server | Critical | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3511 | Counters occupy a good part of AM heap | Blocker | mr-am, mrv2 | Siddharth Seth | Vinod Kumar Vavilapalli
MAPREDUCE-3616 | Thread pool for launching containers in MR AM not expanding as expected | Major | mr-am, mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3402 | AMScalability test of Sleep job with 100K 1-sec maps regressed into running very slowly | Blocker | applicationmaster, mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3380 | Token infrastructure for running clients which are not kerberos authenticated | Blocker | mr-am, mrv2 | Alejandro Abdelnur | Mahadev konar
MAPREDUCE-3618 | TaskHeartbeatHandler holds a global lock for all task-updates | Major | mrv2, performance | Siddharth Seth | Siddharth Seth
MAPREDUCE-3553 | Add support for data returned when exceptions thrown from web service apis to be in either xml or in JSON | Minor | mrv2 | Thomas Graves | Thomas Graves
MAPREDUCE-3512 | Batch jobHistory disk flushes | Blocker | mr-am, mrv2 | Siddharth Seth | Siddharth Seth
MAPREDUCE-3641 | CapacityScheduler should be more conservative assigning off-switch requests | Blocker | mrv2, scheduler | Arun C Murthy | Arun C Murthy
MAPREDUCE-3698 | Client cannot talk to the history server in secure mode | Blocker | mrv2 | Siddharth Seth | Mahadev konar
MAPREDUCE-3525 | Shuffle benchmark is nearly 1.5x slower in 0.23 | Blocker | mrv2 | Karam Singh | Vinod Kumar Vavilapalli
MAPREDUCE-3534 | Compression benchmark run-time increased by 13% in 0.23 | Blocker | mrv2 | Vinay Kumar Thota | Vinod Kumar Vavilapalli
MAPREDUCE-3718 | Default AM heartbeat interval should be one second | Major | mrv2, performance | Vinod Kumar Vavilapalli | Hitesh Shah
HDFS-2864 | Remove redundant methods and a constant from FSDataset | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-3640 | AMRecovery should pick completed task form partial JobHistory files | Blocker | mrv2 | Siddharth Seth | Arun C Murthy
HDFS-2879 | Change FSDataset to package private | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-3711 | AppMaster recovery for Medium to large jobs take long time | Blocker | mrv2 | Siddharth Seth | Robert Joseph Evans
HDFS-2784 | Update hftp and hdfs for host-based token support | Major | hdfs-client, namenode, security | Daryn Sharp | Kihwal Lee
HDFS-2785 | Update webhdfs and httpfs for host-based token support | Major | webhdfs | Daryn Sharp | Robert Joseph Evans
MAPREDUCE-3810 | MR AM’s ContainerAllocator is assigning the allocated containers very slowly | Blocker | mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3813 | RackResolver should maintain a cache to avoid repetitive lookups. | Major | mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3809 | Tasks may take upto 3 seconds to exit after completion | Blocker | mrv2 | Siddharth Seth | Siddharth Seth
MAPREDUCE-3815 | Data Locality suffers if the AM asks for containers using IPs instead of hostnames | Critical | mrv2 | Siddharth Seth | Siddharth Seth
MAPREDUCE-3823 | Counters are getting calculated twice at job-finish and delaying clients. | Major | mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3827 | Counters aggregation slowed down significantly after MAPREDUCE-3749 | Blocker | mrv2, performance | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
HDFS-2786 | Fix host-based token incompatibilities in DFSUtil | Major | namenode, security | Daryn Sharp | Kihwal Lee
MAPREDUCE-3846 | Restarted+Recovered AM hangs in some corner cases | Critical | mrv2 | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-3802 | If an MR AM dies twice it looks like the process freezes | Critical | applicationmaster, mrv2 | Robert Joseph Evans | Vinod Kumar Vavilapalli

### OTHER:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-3297 | Move Log Related components from yarn-server-nodemanager to yarn-common | Major | mrv2 | Siddharth Seth | Siddharth Seth
MAPREDUCE-2733 | Gridmix v3 cpu emulation system tests. | Major | . | Vinay Kumar Thota | Vinay Kumar Thota
MAPREDUCE-3375 | Memory Emulation system tests. | Major | . | Vinay Kumar Thota | Vinay Kumar Thota
HDFS-2552 | Add WebHdfs Forrest doc | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-2587 | Add WebHDFS apt doc | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-3468 | Change version to 0.23.1 for ant builds on the 23 branch | Major | . | Siddharth Seth | Siddharth Seth
HADOOP-7877 | Federation: update Balancer documentation | Major | documentation | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-2574 | remove references to deprecated properties in hdfs-site.xml template and hdfs-default.xml | Trivial | documentation | Joe Crobak | Joe Crobak
MAPREDUCE-3251 | Network ACLs can prevent some clients to talk to MR ApplicationMaster | Critical | mrv2 | Anupam Seth | Anupam Seth
MAPREDUCE-3630 | NullPointerException running teragen | Critical | mrv2 | Amol Kekre | Mahadev konar
MAPREDUCE-3811 | Make the Client-AM IPC retry count configurable | Critical | mrv2 | Siddharth Seth | Siddharth Seth