Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 2.7.0 - 2015-04-20

### INCOMPATIBLE CHANGES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-6252 | Phase out the old web UI in HDFS | Minor | namenode | Fengdong Yu | Haohui Mai
HADOOP-11311 | Restrict uppercase key names from being created with JCEKS | Major | security | Andrew Wang | Andrew Wang
HDFS-7210 | Avoid two separate RPC’s namenode.append() and namenode.getFileInfo() for an append call from DFSClient | Major | hdfs-client, namenode | Vinayakumar B | Vinayakumar B
HADOOP-10530 | Make hadoop trunk build on Java7+ only | Blocker | build | Steve Loughran | Steve Loughran
MAPREDUCE-5420 | Remove mapreduce.task.tmp.dir from mapred-default.xml | Major | . | Sandy Ryza | James Carman
HADOOP-11385 | Prevent cross site scripting attack on JMXJSONServlet | Critical | . | Haohui Mai | Haohui Mai
HADOOP-11498 | Bump the version of HTrace to 3.1.0-incubating | Major | tracing | Masatake Iwasaki | Masatake Iwasaki
HDFS-6651 | Deletion failure can leak inodes permanently | Critical | . | Kihwal Lee | Jing Zhao
HADOOP-11492 | Bump up curator version to 2.7.1 | Major | . | Karthik Kambatla | Arun Suresh
YARN-3217 | Remove httpclient dependency from hadoop-yarn-server-web-proxy | Major | . | Akira Ajisaka | Brahma Reddy Battula
YARN-3154 | Should not upload partial logs for MR jobs or other "short-running’ applications | Blocker | nodemanager, resourcemanager | Xuan Gong | Xuan Gong

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
YARN-2360 | Fair Scheduler: Display dynamic fair share for queues on the scheduler page | Major | fairscheduler | Ashwin Shankar | Ashwin Shankar
HDFS-7222 | Expose DataNode network errors as a metric | Minor | datanode | Charles Lamb | Charles Lamb
HDFS-6663 | Admin command to track file and locations from block id | Major | . | Kihwal Lee | Chen He
HDFS-1362 | Provide volume management functionality for DataNode | Major | datanode | Wang Xu | Wang Xu
HADOOP-7984 | Add hadoop –loglevel option to change log level | Minor | scripts | Eli Collins | Akira Ajisaka
HADOOP-8989 | hadoop fs -find feature | Major | . | Marco Nicosia | Jonathan Allen
HDFS-6982 | nntop: top-like tool for name node users | Major | . | Maysam Yabandeh | Maysam Yabandeh
HADOOP-11341 | KMS support for whitelist key ACLs | Major | kms, security | Arun Suresh | Arun Suresh
HDFS-7424 | Add web UI for NFS gateway | Major | nfs | Brandon Li | Brandon Li
HDFS-7449 | Add metrics to NFS gateway | Major | nfs | Brandon Li | Brandon Li
HADOOP-9629 | Support Windows Azure Storage - Blob as a file system in Hadoop | Major | tools | Mostafa Elhemali | Chris Nauroth
HADOOP-10728 | Metrics system for Windows Azure Storage Filesystem | Major | tools | Mike Liddell | Mike Liddell
YARN-2837 | Timeline server needs to recover the timeline DT when restarting | Blocker | timelineserver | Zhijie Shen | Zhijie Shen
YARN-2574 | Add support for FairScheduler to the ReservationSystem | Major | fairscheduler | Subru Krishnan | Anubhav Dhoot
YARN-2427 | Add support for moving apps between queues in RM web services | Major | resourcemanager | Varun Vasudev | Varun Vasudev
HDFS-3107 | HDFS truncate | Major | datanode, namenode | Lei Chang | Plamen Jeliazkov
HADOOP-11490 | Expose truncate API via FileSystem and shell command | Major | fs | Konstantin Shvachko | Milan Desai
HDFS-3689 | Add support for variable length block | Major | datanode, hdfs-client, namenode | Suresh Srinivas | Jing Zhao
MAPREDUCE-6227 | DFSIO for truncate | Major | benchmarks, test | Konstantin Shvachko | Konstantin Shvachko
HADOOP-11510 | Expose truncate API via FileContext | Major | fs | Yi Liu | Yi Liu
HDFS-7584 | Enable Quota Support for Storage Types | Major | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao
MAPREDUCE-6228 | Add truncate operation to SLive | Major | benchmarks, test | Konstantin Shvachko | Plamen Jeliazkov
YARN-2190 | Add CPU and memory limit options to the default container executor for Windows containers | Major | nodemanager | Chuan Liu | Chuan Liu
HDFS-6488 | Support HDFS superuser in NFSv3 gateway | Major | nfs | Stephen Chu | Brandon Li
HDFS-6826 | Plugin interface to enable delegation of HDFS authorization assertions | Major | security | Alejandro Abdelnur | Arun Suresh

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-8059 | Add javadoc to InterfaceAudience and InterfaceStability | Major | documentation | Suresh Srinivas | Brandon Li
HADOOP-10563 | Remove the dependency of jsp in trunk | Major | . | Haohui Mai | Haohui Mai
YARN-2254 | TestRMWebServicesAppsModification should run against both CS and FS | Minor | . | zhihai xu | zhihai xu
HDFS-7186 | Document the “hadoop trace” command. | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11172 | Improve error message in Shell#runCommand on OutOfMemoryError | Major | . | Yongjun Zhang | Yongjun Zhang
HDFS-7026 | Introduce a string constant for “Failed to obtain user group info…” | Trivial | . | Yongjun Zhang | Yongjun Zhang
YARN-2641 | Decommission nodes on -refreshNodes instead of next NM-RM heartbeat | Major | resourcemanager | zhihai xu | zhihai xu
HDFS-7190 | Bad use of Preconditions in startFileInternal() | Major | namenode | Konstantin Shvachko | Dawson Choong
HDFS-7242 | Code improvement for FSN#checkUnreadableBySuperuser | Minor | namenode | Yi Liu | Yi Liu
HDFS-7252 | small refinement to the use of isInAnEZ in FSNamesystem | Trivial | . | Yi Liu | Yi Liu
HDFS-7266 | HDFS Peercache enabled check should not lock on object | Minor | hdfs-client | Gopal V | Andrew Wang
HDFS-7257 | Add the time of last HA state transition to NN’s /jmx page | Minor | namenode | Charles Lamb | Charles Lamb
HDFS-7223 | Tracing span description of IPC client is too long | Minor | . | Masatake Iwasaki | Masatake Iwasaki
HDFS-7283 | Bump DataNode OOM log from WARN to ERROR | Trivial | datanode | Stephen Chu | Stephen Chu
HADOOP-11231 | Remove dead code in ServletUtil | Minor | . | Haohui Mai | Li Lu
HDFS-7278 | Add a command that allows sysadmins to manually trigger full block reports from a DN | Major | datanode | Colin P. McCabe | Colin P. McCabe
HDFS-6741 | Improve permission denied message when FSPermissionChecker#checkOwner fails | Trivial | . | Stephen Chu | Harsh J
HDFS-7280 | Use netty 4 in WebImageViewer | Major | . | Haohui Mai | Haohui Mai
HDFS-7165 | Separate block metrics for files with replication count 1 | Major | namenode | Andrew Wang | Zhe Zhang
HDFS-3342 | SocketTimeoutException in BlockSender.sendChunks could have a better error message | Minor | datanode | Todd Lipcon | Yongjun Zhang
HADOOP-10987 | Provide an iterator-based listing API for FileSystem | Major | . | Kihwal Lee | Kihwal Lee
HADOOP-10847 | Remove the usage of sun.security.x509.* in testing code | Minor | security | Kai Zheng | pascal oliva
HDFS-7356 | Use DirectoryListing.hasMore() directly in nfs | Minor | nfs | Haohui Mai | Li Lu
HDFS-7357 | FSNamesystem.checkFileProgress should log file path | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-7335 | Redundant checkOperation() in FSN.analyzeFileState() | Major | namenode | Konstantin Shvachko | Milan Desai
HDFS-7333 | Improve log message in Storage.tryLock() | Major | datanode, namenode | Konstantin Shvachko | Konstantin Shvachko
HDFS-7329 | MiniDFSCluster should log the exception when createNameNodesAndSetConf() fails. | Major | test | Konstantin Shvachko | Byron Wong
HDFS-7336 | Unused member DFSInputStream.buffersize | Major | hdfs-client | Konstantin Shvachko | Milan Desai
HDFS-7365 | Remove hdfs.server.blockmanagement.MutableBlockCollection | Minor | . | Li Lu | Li Lu
HDFS-7381 | Decouple the management of block id and gen stamps from FSNamesystem | Major | . | Haohui Mai | Haohui Mai
HDFS-7375 | Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement | Major | . | Haohui Mai | Haohui Mai
YARN-2780 | Log aggregated resource allocation in rm-appsummary.log | Minor | resourcemanager | Koji Noguchi | Eric Payne
HADOOP-11291 | Log the cause of SASL connection failures | Minor | security | Stephen Chu | Stephen Chu
HDFS-7386 | Replace check “port number < 1024” with shared isPrivilegedPort method | Trivial | datanode, security | Yongjun Zhang | Yongjun Zhang
HDFS-7279 | Use netty to implement DatanodeWebHdfsMethods | Major | datanode, webhdfs | Haohui Mai | Haohui Mai
HDFS-7404 | Remove o.a.h.hdfs.server.datanode.web.resources | Major | . | Haohui Mai | Li Lu
YARN-2157 | Document YARN metrics | Major | documentation | Akira Ajisaka | Akira Ajisaka
HDFS-7398 | Reset cached thread-local FSEditLogOp’s on every FSEditLog#logEdit | Major | namenode | Gera Shegalov | Gera Shegalov
YARN-2878 | Fix DockerContainerExecutor.apt.vm formatting | Major | documentation | Abin Shahab | Abin Shahab
HDFS-7409 | Allow dead nodes to finish decommissioning if all files are fully replicated | Minor | . | Andrew Wang | Andrew Wang
YARN-2802 | ClusterMetrics to include AM launch and register delays | Major | resourcemanager | zhihai xu | zhihai xu
HADOOP-11323 | WritableComparator#compare keeps reference to byte array | Major | performance | Wilfred Spiegelenburg | Wilfred Spiegelenburg
MAPREDUCE-6169 | MergeQueue should release reference to the current item from key and value at the end of the iteration to save memory. | Major | mrv2 | zhihai xu | zhihai xu
YARN-2669 | FairScheduler: queue names shouldn’t allow periods | Major | . | Wei Yan | Wei Yan
HDFS-7331 | Add Datanode network counts to datanode jmx page | Minor | datanode | Charles Lamb | Charles Lamb
HDFS-7419 | Improve error messages for DataNode hot swap drive feature | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
HADOOP-11173 | Improve error messages for some KeyShell commands | Minor | . | Andrew Wang | Andrew Wang
HADOOP-11301 | [optionally] update jmx cache to drop old metrics | Major | . | Maysam Yabandeh | Maysam Yabandeh
HDFS-6735 | A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream | Major | hdfs-client | Liang Xie | Lars Hofhansl
YARN-1156 | Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values | Major | . | Akira Ajisaka | Tsuyoshi Ozawa
MAPREDUCE-5932 | Provide an option to use a dedicated reduce-side shuffle log | Major | mrv2 | Gera Shegalov | Gera Shegalov
HDFS-7458 | Add description to the nfs ports in core-site.xml used by nfs test to avoid confusion | Minor | nfs, test | Yongjun Zhang | Yongjun Zhang
YARN-2891 | Failed Container Executor does not provide a clear error message | Minor | nodemanager | Dustin Cote | Dustin Cote
YARN-2301 | Improve yarn container command | Major | . | Jian He | Naganarasimha G R
HDFS-7454 | Reduce memory footprint for AclEntries in NameNode | Major | namenode | Vinayakumar B | Vinayakumar B
HDFS-7478 | Move org.apache.hadoop.hdfs.server.namenode.NNConf to FSNamesystem | Major | . | Li Lu | Li Lu
HADOOP-11313 | Adding a document about NativeLibraryChecker | Major | documentation | Tsuyoshi Ozawa | Tsuyoshi Ozawa
HDFS-7384 | ‘getfacl’ command and ‘getAclStatus’ output should be in sync | Major | namenode | Vinayakumar B | Vinayakumar B
YARN-2604 | Scheduler should consider max-allocation-* in conjunction with the largest node | Major | scheduler | Karthik Kambatla | Robert Kanter
HDFS-7463 | Simplify FSNamesystem#getBlockLocationsUpdateTimes | Major | . | Haohui Mai | Haohui Mai
MAPREDUCE-6046 | Change the class name for logs in RMCommunicator.java | Minor | mr-am | Devaraj K | Sahil Takiar
HDFS-7426 | Change nntop JMX format to be a JSON blob | Major | namenode | Andrew Wang | Andrew Wang
YARN-2950 | Change message to mandate, not suggest JS requirement on UI | Minor | webapp | Harsh J | Dustin Cote
HADOOP-11396 | Provide navigation in the site documentation linking to the Hadoop Compatible File Systems. | Major | documentation | Chris Nauroth | Chris Nauroth
MAPREDUCE-6194 | Bubble up final exception in failures during creation of output collectors | Minor | task | Harsh J | Varun Saxena
HDFS-7513 | HDFS inotify: add defaultBlockSize to CreateEvent | Major | namenode | Colin P. McCabe | Colin P. McCabe
HADOOP-11410 | make the rpath of libhadoop.so configurable | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-11416 | Move ChunkedArrayList into hadoop-common | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-11421 | Add IOUtils#listDirectory | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-10809 | hadoop-azure: page blob support | Major | tools | Mike Liddell | Eric Hanson
HADOOP-11188 | hadoop-azure: automatically expand page blobs when they become full | Major | fs | Eric Hanson | Eric Hanson
HDFS-7531 | Improve the concurrent access on FsVolumeList | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
HADOOP-11427 | ChunkedArrayList: fix removal via iterator and implement get | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-11430 | Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-11422 | Check CryptoCodec is AES-CTR for Crypto input/output stream | Minor | . | Yi Liu | Yi Liu
HADOOP-11395 | Add site documentation for Azure Storage FileSystem integration. | Major | documentation | Chris Nauroth | Chris Nauroth
HDFS-7555 | Remove the support of unmanaged connectors in HttpServer2 | Major | . | Haohui Mai | Haohui Mai
HDFS-7557 | Fix spacing for a few keys in DFSConfigKeys.java | Minor | . | Colin P. McCabe | Colin P. McCabe
YARN-2939 | Fix new findbugs warnings in hadoop-yarn-common | Major | . | Varun Saxena | Li Lu
HDFS-7484 | Make FSDirectory#addINode take existing INodes as its parameter | Major | . | Haohui Mai | Jing Zhao
HADOOP-11399 | Java Configuration file and .xml files should be automatically cross-compared | Minor | . | Ray Chiang | Ray Chiang
YARN-2940 | Fix new findbugs warnings in rest of the hadoop-yarn components | Major | . | Varun Saxena | Li Lu
YARN-2937 | Fix new findbugs warnings in hadoop-yarn-nodemanager | Major | . | Varun Saxena | Varun Saxena
HADOOP-11448 | Fix findbugs warnings in FileBasedIPList | Minor | . | Akira Ajisaka | Tsuyoshi Ozawa
YARN-2938 | Fix new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice | Major | . | Varun Saxena | Varun Saxena
MAPREDUCE-6149 | Document override log4j.properties in MR job | Major | documentation | Junping Du | Junping Du
HADOOP-11455 | KMS and Credential CLI should request confirmation for deletion by default | Minor | security | Charles Lamb | Charles Lamb
HADOOP-11390 | Metrics 2 ganglia provider to include hostname in unresolved address problems | Minor | metrics | Steve Loughran | Varun Saxena
HDFS-7564 | NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map | Minor | nfs | Hari Sekhon | Yongjun Zhang
HADOOP-11032 | Replace use of Guava’s Stopwatch with Hadoop’s StopWatch | Major | . | Gary Steelman | Tsuyoshi Ozawa
YARN-2996 | Refine fs operations in FileSystemRMStateStore and few fixes | Major | resourcemanager | Yi Liu | Yi Liu
HDFS-7579 | Improve log reporting during block report rpc failure | Minor | datanode | Charles Lamb | Charles Lamb
HDFS-7446 | HDFS inotify should have the ability to determine what txid it has read up to | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe
HADOOP-11464 | Reinstate support for launching Hadoop processes on Windows using Cygwin. | Major | bin | Chris Nauroth | Chris Nauroth
HADOOP-9992 | Modify the NN loadGenerator to optionally run as a MapReduce job | Major | test | Akshay Radia | Akshay Radia
HDFS-7182 | JMX metrics aren’t accessible when NN is busy | Major | . | Ming Ma | Ming Ma
HDFS-7323 | Move the get/setStoragePolicy commands out from dfsadmin | Major | hdfs-client | Tsz Wo Nicholas Sze | Jing Zhao
YARN-2957 | Create unit test to automatically compare YarnConfiguration and yarn-default.xml | Minor | . | Ray Chiang | Ray Chiang
HDFS-7326 | Add documentation for hdfs debug commands | Minor | documentation | Colin P. McCabe | Vijay Bhat
HDFS-7598 | Remove dependency on old version of Guava in TestDFSClientCache#testEviction | Minor | test | Sangjin Lee | Sangjin Lee
HDFS-7600 | Refine hdfs admin classes to reuse common code | Major | tools | Yi Liu | Jing Zhao
YARN-2643 | Don’t create a new DominantResourceCalculator on every FairScheduler.allocate call | Trivial | . | Sandy Ryza | Karthik Kambatla
YARN-2679 | Add metric for container launch duration | Major | nodemanager | zhihai xu | zhihai xu
MAPREDUCE-6173 | Document the configuration of deploying MR over distributed cache with enabling wired encryption at the same time | Major | distributed-cache, documentation | Junping Du | Junping Du
HDFS-2219 | Fsck should work with fully qualified file paths. | Minor | tools | Jitendra Nath Pandey | Tsz Wo Nicholas Sze
HADOOP-11481 | ClassCastException while using a key created by keytool to create encryption zone. | Minor | . | Yi Yao | Charles Lamb
HADOOP-11483 | HardLink.java should use the jdk7 createLink method | Major | . | Colin P. McCabe | Akira Ajisaka
YARN-3005 | [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java | Trivial | . | Akira Ajisaka | Kengo Seki
HADOOP-8757 | Metrics should disallow names with invalid characters | Minor | metrics | Todd Lipcon | Ray Chiang
HADOOP-11261 | Set custom endpoint for S3A | Major | fs/s3 | Thomas Demoor | Thomas Demoor
HDFS-7591 | hdfs classpath command should support same options as hadoop classpath. | Minor | scripts | Chris Nauroth | Varun Saxena
HADOOP-11171 | Enable using a proxy server to connect to S3a. | Major | fs/s3 | Thomas Demoor | Thomas Demoor
HDFS-7640 | print NFS Client in the NFS log | Trivial | nfs | Brandon Li | Brandon Li
HDFS-7430 | Rewrite the BlockScanner to use O(1) memory and use multiple threads | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-11419 | improve hadoop-maven-plugins | Minor | build | Hervé Boutemy | Hervé Boutemy
MAPREDUCE-6141 | History server leveldb recovery store | Major | jobhistoryserver | Jason Lowe | Jason Lowe
YARN-3086 | Make NodeManager memory configurable in MiniYARNCluster | Minor | test | Robert Metzger | Robert Metzger
HADOOP-4297 | Enable Java assertions when running tests | Major | build | Yoram Kulbak | Tsz Wo Nicholas Sze
HDFS-7683 | Combine usages and percent stats in NameNode UI | Minor | namenode | Vinayakumar B | Vinayakumar B
HADOOP-10626 | Limit Returning Attributes for LDAP search | Major | security | Jason Hubbard | Jason Hubbard
HDFS-7675 | Remove unused member DFSClient#spanReceiverHost | Trivial | hdfs-client | Konstantin Shvachko | Colin P. McCabe
HADOOP-10525 | Remove DRFA.MaxBackupIndex config from log4j.properties | Minor | . | Akira Ajisaka | Akira Ajisaka
HADOOP-11441 | Hadoop-azure: Change few methods scope to public | Minor | tools | Shashank Khandelwal | Shashank Khandelwal
MAPREDUCE-6150 | Update document of Rumen | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
YARN-3108 | ApplicationHistoryServer doesn’t process -D arguments | Major | . | Chang Li | Chang Li
MAPREDUCE-6151 | Update document of GridMix | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-7706 | Switch BlockManager logging to use slf4j | Minor | namenode | Andrew Wang | Andrew Wang
YARN-3077 | RM should create yarn.resourcemanager.zk-state-store.parent-path recursively | Major | resourcemanager | Chun Chen | Chun Chen
HADOOP-11442 | hadoop-azure: Create test jar | Major | tools | Shashank Khandelwal | Shashank Khandelwal
MAPREDUCE-6143 | add configuration for mapreduce speculative execution in MR2 | Major | mrv2 | zhihai xu | zhihai xu
YARN-3085 | Application summary should include the application type | Major | resourcemanager | Jason Lowe | Rohith Sharma K S
HADOOP-11045 | Introducing a tool to detect flaky tests of hadoop jenkins test job | Major | build, tools | Yongjun Zhang | Yongjun Zhang
YARN-3022 | Expose Container resource information from NodeManager for monitoring | Major | . | Anubhav Dhoot | Anubhav Dhoot
YARN-1393 | SLS: Add how-to-use instructions | Major | . | Wei Yan | Wei Yan
MAPREDUCE-5800 | Use Job#getInstance instead of deprecated constructors | Minor | . | Akira Ajisaka | Akira Ajisaka
YARN-3056 | add verification for containerLaunchDuration in TestNodeManagerMetrics. | Trivial | test | zhihai xu | zhihai xu
HADOOP-11544 | Remove unused configuration keys for tracing | Trivial | . | Masatake Iwasaki | Masatake Iwasaki
YARN-3123 | Make YARN CLI show a single completed container even if the app is running | Major | client | Zhijie Shen | Naganarasimha G R
MAPREDUCE-6059 | Speed up history server startup time | Major | . | Siqi Li | Siqi Li
HADOOP-10976 | moving the source code of hadoop-tools docs to the directory under hadoop-tools | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-7270 | Add congestion signaling capability to DataNode write protocol | Major | datanode | Haohui Mai | Haohui Mai
YARN-1582 | Capacity Scheduler: add a maximum-allocation-mb setting per queue | Major | capacityscheduler | Thomas Graves | Thomas Graves
HADOOP-11506 | Configuration variable expansion regex expensive for long values | Major | conf | Dmitriy V. Ryaboy | Gera Shegalov
HDFS-7732 | Fix the order of the parameters in DFSConfigKeys | Trivial | . | Akira Ajisaka | Brahma Reddy Battula
YARN-3144 | Configuration for making delegation token failures to timeline server not-fatal | Major | . | Jonathan Eagles | Jonathan Eagles
HADOOP-11520 | Clean incomplete multi-part uploads in S3A tests | Minor | fs/s3 | Thomas Demoor | Thomas Demoor
HDFS-7710 | Remove dead code in BackupImage.java | Minor | . | Xiaoyu Yao | Xiaoyu Yao
HDFS-7743 | Code cleanup of BlockInfo and rename BlockInfo to BlockInfoContiguous | Minor | namenode | Jing Zhao | Jing Zhao
YARN-3100 | Make YARN authorization pluggable | Major | . | Jian He | Jian He
HADOOP-11495 | Convert site documentation from apt to markdown | Major | documentation | Allen Wittenauer | Masatake Iwasaki
HDFS-316 | Balancer should run for a configurable # of iterations | Minor | balancer & mover | Brian Bockelman | Xiaoyu Yao
HADOOP-11579 | Documentation for truncate | Major | documentation | Steve Loughran | Konstantin Shvachko
HDFS-7771 | fuse_dfs should permit FILE: on the front of KRB5CCNAME | Major | . | Colin P. McCabe | Colin P. McCabe
HDFS-6133 | Add a feature for replica pinning so that a pinned replica will not be moved by Balancer/Mover. | Major | balancer & mover, datanode | yunjiong zhao | yunjiong zhao
HADOOP-10140 | Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmd | Minor | scripts | Ian Jackson | Kiran Kumar M R
HDFS-7761 | cleanup unnecssary code logic in LocatedBlock | Minor | . | Yi Liu | Yi Liu
HDFS-7703 | Support favouredNodes for the append for new blocks | Major | . | Vinayakumar B | Vinayakumar B
MAPREDUCE-6253 | Update use of Iterator to Iterable | Minor | . | Ray Chiang | Ray Chiang
HADOOP-11543 | Improve help message for hadoop/yarn command | Trivial | scripts | Jagadesh Kiran N | Brahma Reddy Battula
MAPREDUCE-5335 | Rename Job Tracker terminology in ShuffleSchedulerImpl | Major | applicationmaster | Devaraj K | Devaraj K
MAPREDUCE-4431 | mapred command should print the reason on killing already completed jobs | Minor | mrv2 | Nishan Shetty | Devaraj K
YARN-3157 | Refactor the exception handling in ConverterUtils#to*Id | Minor | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
HDFS-7694 | FSDataInputStream should support “unbuffer” | Major | . | Colin P. McCabe | Colin P. McCabe
YARN-3147 | Clean up RM web proxy code | Major | webapp | Steve Loughran | Steve Loughran
HADOOP-11586 | Update use of Iterator to Iterable in AbstractMetricsContext.java | Minor | metrics | Ray Chiang | Ray Chiang
HADOOP-9869 | Configuration.getSocketAddr()/getEnum() should use getTrimmed() | Minor | conf | Steve Loughran | Tsuyoshi Ozawa
YARN-3158 | Correct log messages in ResourceTrackerService | Major | . | Devaraj K | Varun Saxena
YARN-3179 | Update use of Iterator to Iterable | Minor | . | Ray Chiang | Ray Chiang
HDFS-7684 | The host:port settings of the daemons should be trimmed before use | Major | . | Tianyin Xu | Anu Engineer
HDFS-7790 | Do not create optional fields in DFSInputStream unless they are needed | Minor | hdfs-client | Colin P. McCabe | Colin P. McCabe
HDFS-7668 | Convert site documentation from apt to markdown | Major | documentation | Allen Wittenauer | Masatake Iwasaki
YARN-3182 | Cleanup switch statement in ApplicationMasterLauncher#handle() | Minor | . | Ray Chiang | Ray Chiang
MAPREDUCE-6255 | Fix JobCounter’s format to use grouping separator | Minor | client | Ryu Kobayashi | Ryu Kobayashi
HADOOP-11589 | NetUtils.createSocketAddr should trim the input URI | Minor | net | Akira Ajisaka | Rakesh R
MAPREDUCE-6256 | Removed unused private methods in o.a.h.mapreduce.Job.java | Minor | . | Devaraj K | Naganarasimha G R
YARN-3203 | Correct a log message in AuxServices | Minor | . | Brahma Reddy Battula | Brahma Reddy Battula
YARN-1299 | Improve a log message in AppSchedulingInfo by adding application id | Major | resourcemanager | Devaraj K |
HDFS-7604 | Track and display failed DataNode storage locations in NameNode. | Major | datanode, namenode | Chris Nauroth | Chris Nauroth
HDFS-7797 | Add audit log for setQuota operation | Major | namenode | Rakesh R | Rakesh R
HDFS-7795 | Show warning if not all favored nodes were chosen by namenode | Minor | . | Kihwal Lee | Kihwal Lee
HDFS-7780 | Update use of Iterator to Iterable in DataXceiverServer and SnapshotDiffInfo | Minor | . | Ray Chiang | Ray Chiang
HADOOP-11599 | Client#getTimeout should use IPC_CLIENT_PING_DEFAULT when IPC_CLIENT_PING_KEY is not configured. | Minor | ipc | zhihai xu | zhihai xu
HDFS-7772 | Document hdfs balancer -exclude/-include option in HDFSCommands.html | Trivial | documentation | Xiaoyu Yao | Xiaoyu Yao
HADOOP-11440 | Use “test.build.data” instead of “build.test.dir” for testing in ClientBaseWithFixes | Minor | . | Akira Ajisaka | Kengo Seki
HDFS-7752 | Improve description for “dfs.namenode.num.extra.edits.retained” and “dfs.namenode.num.checkpoints.retained” properties on hdfs-default.xml | Minor | documentation | Wellington Chevreuil | Wellington Chevreuil
YARN-2799 | cleanup TestLogAggregationService based on the change in YARN-90 | Minor | test | zhihai xu | zhihai xu
YARN-3230 | Clarify application states on the web UI | Major | . | Jian He | Jian He
HDFS-7773 | Additional metrics in HDFS to be accessed via jmx. | Major | datanode, namenode | Anu Engineer | Anu Engineer
HADOOP-11607 | Reduce log spew in S3AFileSystem | Trivial | fs/s3 | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-3236 | cleanup RMAuthenticationFilter#AUTH_HANDLER_PROPERTY. | Trivial | resourcemanager | zhihai xu | zhihai xu
YARN-2797 | TestWorkPreservingRMRestart should use ParametrizedSchedulerTestBase | Minor | . | Karthik Kambatla | Karthik Kambatla
YARN-3195 | Add -help to yarn logs and nodes CLI command | Minor | client | Jagadesh Kiran N | Jagadesh Kiran N
HADOOP-11632 | Cleanup Find.java to remove SupressWarnings annotations | Minor | . | Akira Ajisaka | Akira Ajisaka
HDFS-7537 | fsck is confusing when dfs.namenode.replication.min > 1 && missing replicas && NN restart | Major | namenode | Allen Wittenauer | Rui Gao
HADOOP-11620 | Add support for load balancing across a group of KMS for HA | Major | kms | Arun Suresh | Arun Suresh
HDFS-7832 | Show ‘Last Modified’ in Namenode’s ‘Browse Filesystem’ | Major | namenode | Vinayakumar B | Vinayakumar B
MAPREDUCE-5612 | Add javadoc for TaskCompletionEvent.Status | Minor | documentation | Sandy Ryza | Chris Palmer
HADOOP-11569 | Provide Merge API for MapFile to merge multiple similar MapFiles to one MapFile | Major | . | Vinayakumar B | Vinayakumar B
HDFS-7308 | DFSClient write packet size may > 64kB | Minor | hdfs-client | Tsz Wo Nicholas Sze | Takuya Fukudome
YARN-2820 | Retry in FileSystemRMStateStore when FS’s operations fail due to IOException. | Major | resourcemanager | zhihai xu | zhihai xu
HDFS-7685 | Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml | Minor | documentation | Frank Lanitz | Kai Sasaki
YARN-3262 | Surface application outstanding resource requests table in RM web UI | Major | yarn | Jian He | Jian He
HDFS-5853 | Add “hadoop.user.group.metrics.percentiles.intervals” to hdfs-default.xml | Minor | documentation, namenode | Akira Ajisaka | Akira Ajisaka
HDFS-7439 | Add BlockOpResponseProto’s message to DFSClient’s exception message | Minor | balancer & mover, datanode, hdfs-client | Ming Ma | Takanobu Asanuma
HDFS-7789 | DFSck should resolve the path to support cross-FS symlinks | Major | tools | Gera Shegalov | Gera Shegalov
HADOOP-11658 | Externalize io.compression.codecs property | Minor | . | Kai Zheng | Kai Zheng
MAPREDUCE-5583 | Ability to limit running map and reduce tasks | Major | mr-am, mrv2 | Jason Lowe | Jason Lowe
HDFS-7757 | Misleading error messages in FSImage.java | Major | namenode | Arpit Agarwal | Brahma Reddy Battula
YARN-3272 | Surface container locality info in RM web UI | Major | . | Jian He | Jian He
MAPREDUCE-6248 | Allow users to get the MR job information for distcp | Major | distcp | Jing Zhao | Jing Zhao
YARN-3285 | Convert branch-2 .apt.vm files of YARN to markdown | Major | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-6565 | Use jackson instead jetty json in hdfs-client | Major | . | Haohui Mai | Akira Ajisaka
HDFS-7535 | Utilize Snapshot diff report for distcp | Major | distcp, snapshots | Jing Zhao | Jing Zhao
MAPREDUCE-6267 | Refactor JobSubmitter#copyAndConfigureFiles into it’s own class | Minor | . | Chris Trezzo | Chris Trezzo
HDFS-7434 | DatanodeID hashCode should not be mutable | Major | namenode | Daryn Sharp | Daryn Sharp
HADOOP-11648 | Set DomainSocketWatcher thread name explicitly | Major | net | Liang Xie | Liang Xie
YARN-3249 | Add a “kill application” button to Resource Manager’s Web UI | Minor | resourcemanager | Ryu Kobayashi | Ryu Kobayashi
HADOOP-11642 | Upgrade azure sdk version from 0.6.0 to 2.0.0 | Major | tools | Shashank Khandelwal | Shashank Khandelwal
HDFS-7411 | Refactor and improve decommissioning logic into DecommissionManager | Major | . | Andrew Wang | Andrew Wang
HDFS-7898 | Change TestAppendSnapshotTruncate to fail-fast | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-6806 | HDFS Rolling upgrade document should mention the versions available | Minor | documentation | Akira Ajisaka | J.Andreina
YARN-3187 | Documentation of Capacity Scheduler Queue mapping based on user or group | Major | capacityscheduler, documentation | Naganarasimha G R | Gururaj Shetty
MAPREDUCE-4815 | Speed up FileOutputCommitter#commitJob for many output files | Major | mrv2 | Jason Lowe | Siqi Li
HDFS-7491 | Add incremental blockreport latency to DN metrics | Minor | datanode | Ming Ma | Ming Ma
HDFS-7435 | PB encoding of block reports is very inefficient | Critical | datanode, namenode | Daryn Sharp | Daryn Sharp
HADOOP-11633 | Convert remaining branch-2 .apt.vm files to markdown | Major | documentation | Colin P. McCabe | Masatake Iwasaki
MAPREDUCE-6265 | Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable to better control to launch/kill containers | Major | mrv2 | zhihai xu | zhihai xu
YARN-2854 | The document about timeline service and generic service needs to be updated | Critical | timelineserver | Zhijie Shen | Naganarasimha G R
HADOOP-11714 | Add more trace log4j messages to SpanReceiverHost | Minor | tracing | Colin P. McCabe | Colin P. McCabe
YARN-3349 | Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry | Minor | test | zhihai xu | zhihai xu
YARN-3273 | Improve web UI to facilitate scheduling analysis and debugging | Major | . | Jian He | Rohith Sharma K S
HDFS-7849 | Update documentation for enabling a new feature in rolling upgrade | Minor | documentation | Tsz Wo Nicholas Sze | J.Andreina
HDFS-7962 | Remove duplicated logs in BlockManager | Minor | . | Yi Liu | Yi Liu
YARN-2777 | Mark the end of individual log in aggregated log | Major | . | Ted Yu | Varun Saxena
HDFS-7917 | Use file to replace data dirs in test to simulate a disk failure. | Minor | test | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-7976 | Update NFS user guide for mount option “sync” to minimize or avoid reordered writes | Major | documentation, nfs | Brandon Li | Brandon Li
MAPREDUCE-6292 | Use org.junit package instead of junit.framework in TestCombineFileInputFormat | Minor | test | Akira Ajisaka | Akira Ajisaka
HADOOP-10670 | Allow AuthenticationFilters to load secret from signature secret files | Minor | security | Kai Zheng | Kai Zheng
HDFS-7410 | Support CreateFlags with append() to support hsync() for appending streams | Major | hdfs-client | Vinayakumar B | Vinayakumar B
HADOOP-11257 | Update “hadoop jar” documentation to warn against using it for launching yarn jars | Blocker | . | Allen Wittenauer | Masatake Iwasaki
HDFS-8071 | Redundant checkFileProgress() in PART II of getAdditionalBlock() | Major | . | Konstantin Shvachko | Konstantin Shvachko
HADOOP-11801 | Update BUILDING.txt for Ubuntu | Minor | documentation | Gabor Liptak | Gabor Liptak

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-10717 | HttpServer2 should load jsp DTD from local jars instead of going remote | Blocker | . | Dapeng Sun | Dapeng Sun
HDFS-6657 | Remove link to ‘Legacy UI’ in Namenode UI | Minor | . | Vinayakumar B | Vinayakumar B
HDFS-6938 | Cleanup javac warnings in FSNamesystem | Trivial | namenode | Charles Lamb | Charles Lamb
HADOOP-10748 | HttpServer2 should not load JspServlet | Major | . | Haohui Mai | Haohui Mai
HADOOP-11156 | DelegateToFileSystem should implement getFsStatus(final Path f). | Major | fs | zhihai xu | zhihai xu
HDFS-7194 | Fix findbugs “inefficient new String constructor” warning in DFSClient#PATH | Trivial | . | Yongjun Zhang | Yongjun Zhang
HADOOP-11166 | Remove ulimit from test-patch.sh | Major | . | Andrew Wang | Andrew Wang
HDFS-7202 | Should be able to omit package name of SpanReceiver on “hadoop trace -add” | Minor | . | Masatake Iwasaki | Masatake Iwasaki
HDFS-7198 | Fix findbugs “unchecked conversion” warning in DFSClient#getPathTraceScope | Trivial | . | Colin P. McCabe | Colin P. McCabe
HDFS-7201 | Fix typos in hdfs-default.xml | Major | . | Konstantin Shvachko | Dawson Choong
HDFS-7277 | Remove explicit dependency on netty 3.2 in BKJournal | Minor | build | Haohui Mai | Haohui Mai
HDFS-7227 | Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in SpanReceiverHost | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-7232 | Populate hostname in httpfs audit log | Trivial | . | Zoran Dimitrijevic | Zoran Dimitrijevic
HDFS-7258 | CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level | Minor | namenode | Xiaoyu Yao | Xiaoyu Yao
YARN-2713 | “RM Home” link in NM should point to one of the RMs in an HA setup | Major | resourcemanager | Karthik Kambatla | Karthik Kambatla
HADOOP-11236 | NFS: Fix javadoc warning in RpcProgram.java | Trivial | documentation | Abhiraj Butala | Abhiraj Butala
HDFS-6538 | Comment format error in ShortCircuitRegistry javadoc | Trivial | datanode | debugging | David Luo
HDFS-7282 | Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC | Major | test | Jinghui Wang | Jinghui Wang
HDFS-7213 | processIncrementalBlockReport performance degradation | Critical | namenode | Daryn Sharp | Eric Payne
HDFS-7301 | TestMissingBlocksAlert should use MXBeans instead of old web UI | Minor | . | Zhe Zhang | Zhe Zhang
HDFS-7235 | DataNode#transferBlock should report blocks that don’t exist using reportBadBlock | Major | datanode, namenode | Yongjun Zhang | Yongjun Zhang
YARN-2742 | FairSchedulerConfiguration should allow extra spaces between value and unit | Minor | fairscheduler | Sangjin Lee | Wei Yan
HADOOP-11186 | documentation should talk about hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classes | Minor | . | Colin P. McCabe | Colin P. McCabe
HADOOP-10840 | Fix OutOfMemoryError caused by metrics system in Azure File System | Major | metrics | shanyu zhao | shanyu zhao
HDFS-7263 | Snapshot read can reveal future bytes for appended files. | Major | hdfs-client | Konstantin Shvachko | Tao Luo
HDFS-7315 | DFSTestUtil.readFileBuffer opens extra FSDataInputStream | Trivial | . | Plamen Jeliazkov | Plamen Jeliazkov
HDFS-6917 | Add an hdfs debug command to validate blocks, call recoverlease, etc. | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe
HADOOP-11268 | Update BUILDING.txt to remove the workaround for tools.jar | Minor | . | Haohui Mai | Li Lu
HADOOP-11230 | Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARN | Major | test | Robert Kanter | Robert Kanter
HADOOP-11269 | Add java 8 profile for hadoop-annotations | Major | . | Haohui Mai | Li Lu
HADOOP-11271 | Use Time.monotonicNow() in Shell.java instead of Time.now() | Minor | . | Vinayakumar B | Vinayakumar B
HADOOP-11266 | Remove no longer supported activation properties for packaging from pom | Trivial | build | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11267 | TestSecurityUtil fails when run with JDK8 because of empty principal names | Minor | security, test | Stephen Chu | Stephen Chu
HADOOP-10714 | AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call | Critical | fs/s3 | David S. Wang | Juan Yu
HADOOP-11272 | Allow ZKSignerSecretProvider and ZKDelegationTokenSecretManager to use the same curator client | Major | . | Arun Suresh | Arun Suresh
HDFS-7366 | BlockInfo should take replication as an short in the constructor | Minor | . | Haohui Mai | Li Lu
HADOOP-11187 | NameNode - KMS communication fails after a long period of inactivity | Major | . | Arun Suresh | Arun Suresh
HDFS-7361 | TestCheckpoint#testStorageAlreadyLockedErrorMessage fails after change of log message related to locking violation. | Minor | datanode, namenode, test | Chris Nauroth | Konstantin Shvachko
HADOOP-10786 | Fix UGI#reloginFromKeytab on Java 8 | Major | security | Tobi Vollebregt | Stephen Chu
HADOOP-11289 | Fix typo in RpcUtil log message | Trivial | net | Charles Lamb | Charles Lamb
HADOOP-11294 | Nfs3FileAttributes should not change the values of rdev, nlink and size in the constructor | Minor | nfs | Brandon Li | Brandon Li
YARN-2735 | diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection | Trivial | nodemanager | zhihai xu | zhihai xu
YARN-570 | Time strings are formated in different timezone | Major | webapp | Peng Zhang | Akira Ajisaka
HDFS-7389 | Named user ACL cannot stop the user from accessing the FS entity. | Major | namenode | Chunjun Xiao | Vinayakumar B
HDFS-7358 | Clients may get stuck waiting when using ByteArrayManager | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-7395 | BlockIdManager#clear() bails out when resetting the GenerationStampV1Limit | Major | namenode | Yongjun Zhang | Haohui Mai
YARN-2856 | Application recovery throw InvalidStateTransitonException: Invalid event: ATTEMPT_KILLED at ACCEPTED | Critical | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
MAPREDUCE-5918 | LineRecordReader can return the same decompressor to CodecPool multiple times | Major | . | Sergey Murylev | Sergey Murylev
YARN-2857 | ConcurrentModificationException in ContainerLogAppender | Critical | . | Mohammad Kamrul Islam | Mohammad Kamrul Islam
YARN-2816 | NM fail to start with NPE during container recovery | Major | nodemanager | zhihai xu | zhihai xu
YARN-2811 | In Fair Scheduler, reservation fulfillments shouldn’t ignore max share | Major | . | Siqi Li | Siqi Li
YARN-2432 | RMStateStore should process the pending events before close | Major | resourcemanager | Varun Saxena | Varun Saxena
YARN-1703 | Too many connections are opened for proxy server when applicationMaster UI is accessed. | Critical | . | Rohith Sharma K S | Rohith Sharma K S
HDFS-7394 | Log at INFO level, not WARN level, when InvalidToken is seen in ShortCircuitCache | Minor | . | Kihwal Lee | Keith Pak
HDFS-7399 | Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock() | Minor | . | Ted Yu | Vinayakumar B
HADOOP-11157 | ZKDelegationTokenSecretManager never shuts down listenerThreadPool | Major | security | Gregory Chanan | Arun Suresh
YARN-2414 | RM web UI: app page will crash if app is failed before any attempt has been created | Major | webapp | Zhijie Shen | Wangda Tan
HDFS-7146 | NFS ID/Group lookup requires SSSD enumeration on the server | Major | nfs | Yongjun Zhang | Yongjun Zhang
MAPREDUCE-6162 | mapred hsadmin fails on a secure cluster | Blocker | jobhistoryserver | Jason Lowe | Jason Lowe
MAPREDUCE-6049 | AM JVM does not exit if MRClientService gracefull shutdown fails | Major | applicationmaster, resourcemanager | Nishan Shetty | Rohith Sharma K S
HADOOP-11309 | System class pattern package.Foo should match package.Foo$Bar, too | Blocker | . | Gera Shegalov | Gera Shegalov
HADOOP-11312 | Fix unit tests to not use uppercase key names | Major | security | Andrew Wang | Andrew Wang
HDFS-7406 | SimpleHttpProxyHandler puts incorrect “Connection: Close” header | Major | . | Haohui Mai | Haohui Mai
YARN-2870 | Update examples in document of Timeline Server | Trivial | documentation, timelineserver | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11201 | Hadoop Archives should support globs resolving to files | Blocker | tools | Gera Shegalov | Gera Shegalov
HDFS-7374 | Allow decommissioning of dead DataNodes | Major | . | Zhe Zhang | Zhe Zhang
HDFS-7225 | Remove stale block invalidation work when DN re-registers with different UUID | Major | namenode | Zhe Zhang | Zhe Zhang
YARN-2865 | Application recovery continuously fails with “Application with id already present. Cannot duplicate” | Critical | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
YARN-2315 | FairScheduler: Set current capacity in addition to capacity | Major | . | zhihai xu | zhihai xu
HDFS-7403 | Inaccurate javadoc of BlockUCState#COMPLETE state | Trivial | namenode | Yongjun Zhang | Yongjun Zhang
YARN-2697 | RMAuthenticationHandler is no longer useful | Major | resourcemanager | Zhijie Shen | haosdent
HDFS-7303 | NN UI fails to distinguish datanodes on the same host | Minor | . | Benoy Antony | Benoy Antony
HADOOP-11322 | key based ACL check in KMS always check KeyOpType.MANAGEMENT even actual KeyOpType is not MANAGEMENT | Major | security | Dian Fu | Dian Fu
MAPREDUCE-5568 | JHS returns invalid string for reducer completion percentage if AM restarts with 0 reducer. | Major | . | Jian He | MinJi Kim
HADOOP-11300 | KMS startup scripts must not display the keystore / truststore passwords | Major | kms | Arun Suresh | Arun Suresh
YARN-2906 | CapacitySchedulerPage shows HTML tags for a queue’s Active Users | Major | capacityscheduler | Jason Lowe | Jason Lowe
HDFS-7097 | Allow block reports to be processed during checkpointing on standby name node | Critical | . | Kihwal Lee | Kihwal Lee
HDFS-7444 | convertToBlockUnderConstruction should preserve BlockCollection | Major | . | Haohui Mai | Haohui Mai
YARN-2907 | SchedulerNode#toString should print all resource detail instead of only memory. | Trivial | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HADOOP-11333 | Fix deadlock in DomainSocketWatcher when the notification pipe is full | Major | . | yunjiong zhao | yunjiong zhao
MAPREDUCE-6172 | TestDbClasses timeouts are too aggressive | Minor | test | Jason Lowe | Varun Saxena
YARN-2905 | AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted | Blocker | . | Jason Lowe | Varun Saxena
MAPREDUCE-6160 | Potential NullPointerException in MRClientProtocol interface implementation. | Major | . | Rohith Sharma K S | Rohith Sharma K S
HADOOP-11337 | KeyAuthorizationKeyProvider access checks need to be done atomically | Major | . | Dian Fu | Dian Fu
YARN-2136 | RMStateStore can explicitly handle store/update events when fenced | Major | . | Jian He | Varun Saxena
YARN-2894 | When ACL’s are enabled, if RM switches then application can not be viewed from web. | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HADOOP-11344 | KMS kms-config.sh sets a default value for the keystore password even in non-ssl setup | Major | . | Arun Suresh | Arun Suresh
HADOOP-11342 | KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACL | Major | kms, security | Dian Fu | Dian Fu
YARN-2874 | Dead lock in “DelegationTokenRenewer” which blocks RM to execute any further apps | Blocker | resourcemanager | Naganarasimha G R | Naganarasimha G R
HADOOP-11332 | KerberosAuthenticator#doSpnegoSequence should check if kerberos TGT is available in the subject | Major | security | Dian Fu | Dian Fu
HADOOP-11348 | Remove unused variable from CMake error message for finding openssl | Minor | . | Dian Fu | Dian Fu
HDFS-7472 | Fix typo in message of ReplicaNotFoundException | Trivial | . | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11355 | When accessing data in HDFS and the key has been deleted, a Null Pointer Exception is shown. | Minor | . | Arun Suresh | Arun Suresh
YARN-2461 | Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration | Minor | . | Ray Chiang | Ray Chiang
YARN-2869 | CapacityScheduler should trim sub queue names when parse configuration | Major | capacityscheduler, resourcemanager | Wangda Tan | Wangda Tan
HADOOP-11343 | Overflow is not properly handled in caclulating final iv for AES CTR | Blocker | security | Haifeng Chen | Haifeng Chen
MAPREDUCE-6177 | Minor typo in the EncryptedShuffle document about ssl-client.xml | Trivial | documentation | wyp | wyp
HDFS-7473 | Document setting dfs.namenode.fs-limits.max-directory-items to 0 is invalid | Major | documentation | Jason Keller | Akira Ajisaka
HADOOP-11354 | ThrottledInputStream doesn’t perform effective throttling | Major | . | Ted Yu | Ted Yu
HADOOP-11329 | Add JAVA_LIBRARY_PATH to KMS startup options | Major | kms, security | Dian Fu | Arun Suresh
HADOOP-11287 | Simplify UGI#reloginFromKeytab for Java 7+ | Major | . | Haohui Mai | Li Lu
YARN-2931 | PublicLocalizer may fail until directory is initialized by LocalizeRunner | Critical | nodemanager | Anubhav Dhoot | Anubhav Dhoot
HADOOP-11363 | Hadoop maven surefire-plugin uses must set heap size | Major | build | Steve Loughran | Steve Loughran
HADOOP-10134 | [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments | Minor | . | Andrew Purtell | Andrew Purtell
HDFS-7490 | HDFS tests OOM on Java7+ | Major | build, test | Steve Loughran | Steve Loughran
HADOOP-11368 | Fix SSLFactory truststore reloader thread leak in KMSClientProvider | Major | kms | Arun Suresh | Arun Suresh
HADOOP-11273 | TestMiniKdc failure: login options not compatible with IBM JDK | Major | test | Gao Zhong Liang | Gao Zhong Liang
YARN-2910 | FSLeafQueue can throw ConcurrentModificationException | Major | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg
HADOOP-11349 | RawLocalFileSystem leaks file descriptor while creating a file if creat succeeds but chmod fails. | Minor | fs | Chris Nauroth | Varun Saxena
HDFS-7481 | Add ACL indicator to the “Permission Denied” exception. | Minor | namenode | Vinayakumar B | Vinayakumar B
HDFS-7502 | Fix findbugs warning in hdfs-nfs project | Major | nfs | Brandon Li | Brandon Li
HADOOP-11388 | Remove deprecated o.a.h.metrics.file.FileContext | Minor | . | Haohui Mai | Li Lu
HADOOP-11386 | Replace \n by %n in format hadoop-common format strings | Major | . | Li Lu | Li Lu
HDFS-5578 | [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments | Minor | . | Andrew Purtell | Andrew Purtell
YARN-2917 | Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook | Critical | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HDFS-7515 | Fix new findbugs warnings in hadoop-hdfs | Major | . | Haohui Mai | Haohui Mai
HADOOP-11211 | mapreduce.job.classloader.system.classes semantics should be order-independent | Major | . | Yitong Zhou | Yitong Zhou
HDFS-7497 | Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui | Major | datanode, namenode | Yongjun Zhang | Yongjun Zhang
YARN-2243 | Order of arguments for Preconditions.checkNotNull() is wrong in SchedulerApplicationAttempt ctor | Minor | . | Ted Yu | Devaraj K
YARN-2912 | Jersey Tests failing with port in use | Major | test | Steve Loughran | Varun Saxena
HDFS-7517 | Remove redundant non-null checks in FSNamesystem#getBlockLocations | Major | . | Haohui Mai | Haohui Mai
HDFS-7514 | TestTextCommand fails on Windows | Major | test | Arpit Agarwal | Arpit Agarwal
HADOOP-11238 | Update the NameNode’s Group Cache in the background when possible | Minor | . | Chris Li | Chris Li
HADOOP-11394 | hadoop-aws documentation missing. | Major | documentation | Chris Nauroth | Chris Nauroth
MAPREDUCE-4879 | TeraOutputFormat may overwrite an existing output directory | Major | examples | Gera Shegalov | Gera Shegalov
YARN-2356 | yarn status command for non-existent application/application attempt/container is too verbose | Minor | client | Sunil Govindan | Sunil Govindan
HDFS-7516 | Fix findbugs warnings in hadoop-nfs project | Major | nfs | Brandon Li | Brandon Li
HADOOP-10852 | NetgroupCache is not thread-safe | Major | security | Benoy Antony | Benoy Antony
MAPREDUCE-6166 | Reducers do not validate checksum of map outputs when fetching directly to disk | Major | mrv2 | Eric Payne | Eric Payne
HADOOP-11412 | POMs mention “The Apache Software License” rather than “Apache License” | Trivial | . | Hervé Boutemy | Hervé Boutemy
HDFS-6425 | Large postponedMisreplicatedBlocks has impact on blockReport latency | Major | namenode | Ming Ma | Ming Ma
HDFS-7494 | Checking of closed in DFSInputStream#pread() should be protected by synchronization | Minor | . | Ted Yu | Ted Yu
HDFS-7536 | Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs | Minor | security | Yi Liu | Yi Liu
HADOOP-11321 | copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. | Major | fs | Chris Nauroth | Chris Nauroth
YARN-2945 | FSLeafQueue#assignContainer - document the reason for using both write and read locks | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa
HADOOP-11420 | Use latest maven-site-plugin and replace link to svn with link to git | Trivial | site | Hervé Boutemy | Hervé Boutemy
HADOOP-10689 | InputStream is not closed in AzureNativeFileSystemStore#retrieve() | Minor | tools | Ted Yu | Chen He
HADOOP-10690 | Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close() | Minor | tools | Ted Yu | Chen He
HADOOP-11248 | Add hadoop configuration to disable Azure Filesystem metrics collection | Major | fs | shanyu zhao | shanyu zhao
YARN-2972 | DelegationTokenRenewer thread pool never expands | Major | resourcemanager | Jason Lowe | Jason Lowe
HADOOP-11246 | Move jenkins to Java 7 | Major | . | Haohui Mai | Steve Loughran
HDFS-7373 | Clean up temporary files after fsimage transfer failures | Major | . | Kihwal Lee | Kihwal Lee
HADOOP-11409 | FileContext.getFileContext can stack overflow if default fs misconfigured | Major | . | Jason Lowe | Gera Shegalov
HADOOP-11428 | Remove obsolete reference to Cygwin in BUILDING.txt | Major | documentation | Arpit Agarwal | Arpit Agarwal
HDFS-7530 | Allow renaming of encryption zone roots | Minor | namenode | Charles Lamb | Charles Lamb
HDFS-7431 | log message for InvalidMagicNumberException may be incorrect | Major | security | Yi Liu | Yi Liu
YARN-2964 | RM prematurely cancels tokens for jobs that submit jobs (oozie) | Blocker | resourcemanager | Daryn Sharp | Jian He
HADOOP-11431 | clean up redundant maven-site-plugin configuration | Major | . | Hervé Boutemy | Hervé Boutemy
HDFS-7552 | change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration | Major | datanode, test | Liang Xie | Liang Xie
MAPREDUCE-6045 | need close the DataInputStream after open it in TestMapReduce.java | Minor | test | zhihai xu | zhihai xu
HADOOP-11213 | Typos in html pages: SecureMode and EncryptedShuffle | Minor | . | Wei Yan | Wei Yan
YARN-2675 | containersKilled metrics is not updated when the container is killed during localization | Major | nodemanager | zhihai xu | zhihai xu
YARN-2952 | Incorrect version check in RMStateStore | Major | . | Jian He | Rohith Sharma K S
YARN-2977 | TestNMClient get failed intermittently | Major | . | Junping Du | Junping Du
YARN-2975 | FSLeafQueue app lists are accessed without required locks | Blocker | . | Karthik Kambatla | Karthik Kambatla
HADOOP-11411 | Hive build failure on hadoop-2.7 due to HADOOP-11356 | Major | . | Jason Dere |
HADOOP-11414 | FileBasedIPList#readLines() can leak file descriptors | Minor | . | Ted Yu | Tsuyoshi Ozawa
HDFS-7560 | ACLs removed by removeDefaultAcl() will be back after NameNode restart/failover | Critical | namenode | Vinayakumar B | Vinayakumar B
YARN-2340 | NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application’s and remain in standby | Critical | resourcemanager, scheduler | Nishan Shetty | Rohith Sharma K S
HDFS-7456 | De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode | Major | namenode | Vinayakumar B | Vinayakumar B
YARN-2988 | Graph#save() may leak file descriptors | Minor | . | Ted Yu | Ted Yu
HADOOP-11283 | Potentially unclosed SequenceFile.Writer in DistCpV1#setup() | Minor | . | Ted Yu | Varun Saxena
YARN-2993 | Several fixes (missing acl check, error log msg …) and some refinement in AdminService | Major | resourcemanager | Yi Liu | Yi Liu
YARN-2992 | ZKRMStateStore crashes due to session expiry | Blocker | resourcemanager | Karthik Kambatla | Karthik Kambatla
HADOOP-11039 | ByteBufferReadable API doc is inconsistent with the implementations. | Minor | documentation | Yi Liu | Yi Liu
YARN-2987 | ClientRMService#getQueueInfo doesn’t check app ACLs | Major | . | Jian He | Varun Saxena
HDFS-7563 | NFS gateway parseStaticMap NumberFormatException | Major | nfs | Hari Sekhon | Yongjun Zhang
YARN-2991 | TestRMRestart.testDecomissionedNMsMetricsOnRMRestart intermittently fails on trunk | Blocker | . | Zhijie Shen | Rohith Sharma K S
YARN-2983 | NPE possible in ClientRMService#getQueueInfo | Major | resourcemanager | Varun Saxena | Varun Saxena
YARN-2922 | ConcurrentModificationException in CapacityScheduler’s LeafQueue | Major | capacityscheduler, resourcemanager, scheduler | Jason Tufo | Rohith Sharma K S
HADOOP-11446 | S3AOutputStream should use shared thread pool to avoid OutOfMemoryError | Major | fs/s3 | Ted Yu | Ted Yu
HDFS-7572 | TestLazyPersistFiles#testDnRestartWithSavedReplicas is flaky on Windows | Major | test | Arpit Agarwal | Arpit Agarwal
YARN-2958 | RMStateStore seems to unnecessarily and wrongly store sequence number separately | Blocker | resourcemanager | Zhijie Shen | Varun Saxena
HADOOP-11402 | Negative user-to-group cache entries are never cleared for never-again-accessed users | Major | . | Colin P. McCabe | Varun Saxena
HADOOP-11459 | Fix recent findbugs in ActiveStandbyElector, NetUtils and ShellBasedIdMapping | Minor | . | Vinayakumar B | Vinayakumar B
HDFS-7583 | Fix findbug in TransferFsImage.java | Minor | namenode | Vinayakumar B | Vinayakumar B
HADOOP-11445 | Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split | Critical | . | Ankit Kamboj | Ankit Kamboj
YARN-2978 | ResourceManager crashes with NPE while getting queue info | Critical | . | Jason Tufo | Varun Saxena
MAPREDUCE-6206 | TestAggregatedTransferRate fails on non-US systems | Critical | . | Jens Rabe | Jens Rabe
YARN-2230 | Fix description of yarn.scheduler.maximum-allocation-vcores in yarn-default.xml (or code) | Minor | client, documentation, scheduler | Adam Kawa | Vijay Bhat
HADOOP-11462 | TestSocketIOWithTimeout needs change for PowerPC platform | Major | test | Ayappan | Ayappan
YARN-3010 | Fix recent findbug issue in AbstractYarnScheduler | Minor | . | Yi Liu | Yi Liu
HDFS-7561 | TestFetchImage should write fetched-image-dir under target. | Major | . | Konstantin Shvachko | Liang Xie
YARN-2936 | YARNDelegationTokenIdentifier doesn’t set proto.builder now | Major | . | Zhijie Shen | Varun Saxena
YARN-2997 | NM keeps sending already-sent completed containers to RM until containers are removed from context | Major | nodemanager | Chengbing Liu | Chengbing Liu
HADOOP-11470 | Remove some uses of obsolete guava APIs from the hadoop codebase | Major | . | Sangjin Lee | Sangjin Lee
YARN-2956 | Some yarn-site index linked pages are difficult to discover because are not in the side bar | Minor | documentation | Remus Rusanu | Masatake Iwasaki
HADOOP-11400 | GraphiteSink does not reconnect to Graphite after ‘broken pipe’ | Major | metrics | Kamil Gorlo | Kamil Gorlo
HDFS-7596 | NameNode should prune dead storages from storageMap | Major | namenode | Arpit Agarwal | Arpit Agarwal
YARN-3027 | Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation | Major | . | Anubhav Dhoot | Anubhav Dhoot
HDFS-7533 | Datanode sometimes does not shutdown on receiving upgrade shutdown command | Major | . | Kihwal Lee | Eric Payne
HDFS-5445 | PacketReceiver populates the packetLen field in PacketHeader incorrectly | Minor | datanode | Jonathan Mace | Jonathan Mace
HDFS-7470 | SecondaryNameNode need twice memory when calling reloadFromImageFile | Major | namenode | yunjiong zhao | yunjiong zhao
YARN-2637 | maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications. | Critical | resourcemanager | Wangda Tan | Craig Welch
MAPREDUCE-6210 | Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java | Minor | applicationmaster | Leitao Guo | Leitao Guo
HADOOP-11318 | Update the document for hadoop fs -stat | Major | documentation | Akira Ajisaka | Akira Ajisaka
YARN-2861 | Timeline DT secret manager should not reuse the RM’s configs. | Major | . | Zhijie Shen | Zhijie Shen
HDFS-7615 | Remove longReadLock | Major | . | Kihwal Lee | Kihwal Lee
HDFS-7457 | DatanodeID generates excessive garbage | Major | namenode | Daryn Sharp | Daryn Sharp
HADOOP-11350 | The size of header buffer of HttpServer is too small when HTTPS is enabled | Major | security | Benoy Antony | Benoy Antony
YARN-3064 | TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout | Critical | scheduler | Wangda Tan | Jian He
HDFS-7635 | Remove TestCorruptFilesJsp from branch-2. | Minor | test | Chris Nauroth | Chris Nauroth
HDFS-7632 | MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode. | Major | test | Chris Nauroth | Chris Nauroth
HDFS-7606 | Missing null check in INodeFile#getBlocks() | Minor | . | Ted Yu | Byron Wong
YARN-2815 | Remove jline from hadoop-yarn-server-common | Major | . | Ferdinand Xu | Ferdinand Xu
HADOOP-10542 | Potential null pointer dereference in Jets3tFileSystemStore#retrieveBlock() | Minor | fs/s3 | Ted Yu | Ted Yu
YARN-3071 | Remove invalid char from sample conf in doc of FairScheduler | Trivial | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-7637 | Fix the check condition for reserved path | Minor | . | Yi Liu | Yi Liu
YARN-3015 | yarn classpath command should support same options as hadoop classpath. | Minor | scripts | Chris Nauroth | Varun Saxena
YARN-2731 | Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder | Major | . | Carlo Curino | Carlo Curino
HDFS-7641 | Update archival storage user doc for list/set/get block storage policies | Minor | documentation | Yi Liu | Yi Liu
HDFS-7496 | Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances | Major | . | Colin P. McCabe | Lei (Eddy) Xu
HDFS-7610 | Fix removal of dynamically added DN volumes | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
HADOOP-11256 | Some site docs have inconsistent appearance | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11327 | BloomFilter#not() omits the last bit, resulting in an incorrect filter | Minor | util | Tim Luo | Eric Payne
HDFS-7548 | Corrupt block reporting delayed until datablock scanner thread detects it | Major | . | Rushabh S Shah | Rushabh S Shah
MAPREDUCE-3283 | mapred classpath CLI does not display the complete classpath | Minor | scripts | Ramya Sunil | Varun Saxena
HADOOP-11209 | Configuration#updatingResource/finalParameters are not thread-safe | Major | conf | Josh Rosen | Varun Saxena
YARN-3078 | LogCLIHelpers lacks of a blank space before string ‘does not exist’ | Minor | log-aggregation | sam liu |
HADOOP-11500 | InputStream is left unclosed in ApplicationClassLoader | Major | . | Ted Yu | Ted Yu
HDFS-7575 | Upgrade should generate a unique storage ID for each volume | Critical | . | Lars Francke | Arpit Agarwal
HADOOP-11008 | Remove duplicated description about proxy-user in site documents | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-3519 | Checkpoint upload may interfere with a concurrent saveNamespace | Critical | namenode | Todd Lipcon | Ming Ma
HADOOP-11493 | Fix some typos in kms-acls.xml description | Trivial | kms | Charles Lamb | Charles Lamb
HDFS-7660 | BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly. | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-3082 | Non thread safe access to systemCredentials in NodeHeartbeatResponse processing | Major | . | Anubhav Dhoot | Anubhav Dhoot
HADOOP-11507 | Hadoop RPC Authentication problem with different user locale | Minor | . | Talat UYARER | Talat UYARER
HADOOP-11482 | Use correct UGI when KMSClientProvider is called by a proxy user | Major | . | Arun Suresh | Arun Suresh
HDFS-7644 | minor typo in HttpFS doc | Trivial | documentation | Charles Lamb | Charles Lamb
YARN-3024 | LocalizerRunner should give DIE action when all resources are localized | Major | nodemanager | Chengbing Liu | Chengbing Liu
HADOOP-11450 | Cleanup DistCpV1 not to use deprecated methods and fix javadocs | Minor | tools/distcp | Tsuyoshi Ozawa | Varun Saxena
HDFS-7224 | Allow reuse of NN connections via webhdfs | Major | webhdfs | Eric Payne | Eric Payne
YARN-3088 | LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error | Major | nodemanager | Jason Lowe | Eric Payne
HADOOP-11499 | Check of executorThreadsStarted in ValueQueue#submitRefillTask() evades lock acquisition | Minor | . | Ted Yu | Ted Yu
HADOOP-6221 | RPC Client operations cannot be interrupted | Minor | ipc | Steve Loughran | Steve Loughran
HADOOP-11509 | change parsing sequence in GenericOptionsParser to parse -D parameters first | Major | . | Xuan Gong | Xuan Gong
HDFS-49 | MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found | Minor | test | Steve Loughran | Steve Loughran
YARN-2897 | CrossOriginFilter needs more log statements | Major | . | Mit Desai | Mit Desai
HDFS-7566 | Remove obsolete entries from hdfs-default.xml | Major | . | Ray Chiang | Ray Chiang
YARN-2932 | Add entry for “preemptable” status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging | Major | . | Eric Payne | Eric Payne
HADOOP-11469 | KMS should skip default.key.acl and whitelist.key.acl when loading key acl | Minor | kms | Dian Fu | Dian Fu
HADOOP-11316 | “mvn package -Pdist,docs -DskipTests -Dtar” fails because of non-ascii characters | Blocker | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa
YARN-3103 | AMRMClientImpl does not update AMRM token properly | Blocker | client | Jason Lowe | Jason Lowe
HDFS-7611 | deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart. | Critical | namenode | Konstantin Shvachko | Jing Zhao
MAPREDUCE-6230 | MR AM does not survive RM restart if RM activated a new AMRM secret key | Blocker | mr-am | Jason Lowe | Jason Lowe
HDFS-7423 | various typos and message formatting fixes in nfs daemon and doc | Trivial | nfs | Charles Lamb | Charles Lamb
YARN-3079 | Scheduler should also update maximumAllocation when updateNodeResource. | Major | . | zhihai xu | zhihai xu
MAPREDUCE-6231 | Grep example job is not working on a fully-distributed cluster | Major | examples | Akira Ajisaka | Akira Ajisaka
HADOOP-9907 | Webapp http://hostname:port/metrics link is not working | Critical | . | Jian He | Akira Ajisaka
HDFS-7603 | The background replication queue initialization may not let others run | Critical | rolling upgrades | Kihwal Lee | Kihwal Lee
YARN-3029 | FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere | Major | nodemanager | Steve Loughran | Varun Saxena
HADOOP-11403 | Avoid using sys_errlist on Solaris, which lacks support for it | Major | . | Malcolm Kavalsky | Malcolm Kavalsky
HADOOP-11523 | StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB | Major | tools | Duo Xu | Duo Xu
HADOOP-9137 | Support connection limiting in IPC server | Major | . | Sanjay Radia | Kihwal Lee
HADOOP-11488 | Difference in default connection timeout for S3A FS | Minor | fs/s3 | Harsh J | Daisuke Kobayashi
HADOOP-11494 | Lock acquisition on WrappedInputStream#unwrappedRpcBuffer may race with another thread | Minor | . | Ted Yu | Ted Yu
YARN-3113 | Release audit warning for “Sorting icons.psd” | Major | . | Chang Li | Steve Loughran
HADOOP-10181 | GangliaContext does not work with multicast ganglia setup | Minor | metrics | Andrew Otto | Andrew Johnson
YARN-2808 | yarn client tool can not list app_attempt’s container info correctly | Major | client | Gordon Wang | Naganarasimha G R
HDFS-7696 | FsDatasetImpl.getTmpInputStreams(..) may leak file descriptors | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-11529 | Fix findbugs warnings in hadoop-archives | Minor | tools | Masatake Iwasaki | Masatake Iwasaki
HDFS-7721 | The HDFS BlockScanner may run fast during the first hour | Major | datanode | Tsz Wo Nicholas Sze | Colin P. McCabe
HDFS-7707 | Edit log corruption due to delayed block removal again | Major | namenode | Yongjun Zhang | Yongjun Zhang
YARN-3058 | Fix error message of tokens’ activation delay configuration | Minor | . | Yi Liu | Yi Liu
HADOOP-11546 | Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck | Major | build | Steve Loughran | Tsuyoshi Ozawa
MAPREDUCE-6243 | Fix findbugs warnings in hadoop-rumen | Minor | tools/rumen | Akira Ajisaka | Masatake Iwasaki
HADOOP-11548 | checknative should display a nicer error message when openssl support is not compiled in | Major | build, native | Colin P. McCabe | Anu Engineer
HDFS-7734 | Class cast exception in NameNode#main | Blocker | namenode | Arpit Agarwal | Yi Liu
HADOOP-11547 | hadoop-common native compilation fails on Windows due to missing support for __attribute__ declaration. | Major | native | Chris Nauroth | Chris Nauroth
HDFS-7719 | BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes | Major | . | Lei (Eddy) Xu | Lei (Eddy) Xu
HADOOP-11549 | flaky test detection tool failed to handle special control characters in test result | Major | tools | Yongjun Zhang | Yongjun Zhang
MAPREDUCE-5988 | Fix dead links to the javadocs in mapreduce project | Minor | documentation | Akira Ajisaka | Akira Ajisaka
HADOOP-10062 | race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect results | Major | metrics | Shinichi Yamashita | Sangjin Lee
HDFS-7709 | Fix findbug warnings in httpfs | Major | . | Rakesh R | Rakesh R
YARN-3101 | In Fair Scheduler, fix canceling of reservations for exceeding max share | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot
MAPREDUCE-6186 | Redundant call to requireJob() while displaying the conf page | Minor | jobhistoryserver | Rohit Agarwal | Rohit Agarwal
MAPREDUCE-6233 | org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort failed in trunk | Major | test | Yongjun Zhang | zhihai xu
YARN-3149 | Typo in message for invalid application id | Trivial | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
YARN-3145 | ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo | Major | . | Jian He | Tsuyoshi Ozawa
HDFS-7698 | Fix locking on HDFS read statistics and add a method for clearing them. | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-11526 | Memory leak in Bzip2Compressor and Bzip2Decompressor | Major | io, native | Ian Rogers | Anu Engineer
HDFS-7741 | Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream | Minor | . | Yi Liu | Yi Liu
YARN-3089 | LinuxContainerExecutor does not handle file arguments to deleteAsUser | Blocker | . | Jason Lowe | Eric Payne
YARN-3143 | RM Apps REST API can return NPE or entries missing id and other fields | Major | webapp | Kendall Thrapp | Jason Lowe
YARN-2990 | FairScheduler’s delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests | Major | fairscheduler | Karthik Kambatla | Karthik Kambatla
HDFS-7647 | DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs | Major | . | Milan Desai | Milan Desai
YARN-3094 | reset timer for liveness monitors after RM recovery | Major | resourcemanager | Jun Gong | Jun Gong
YARN-3155 | Refactor the exception handling code for TimelineClientImpl’s retryOn method | Minor | . | Li Lu | Li Lu
HDFS-7756 | Restore method signature for LocatedBlock#getLocations() | Major | . | Ted Yu | Ted Yu
HDFS-7744 | Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe
HDFS-7718 | Store KeyProvider in ClientContext to avoid leaking key provider threads when using FileContext | Major | . | Arun Suresh | Arun Suresh
HDFS-7714 | Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode. | Major | datanode | Chris Nauroth | Vinayakumar B
HADOOP-11512 | Use getTrimmedStrings when reading serialization keys | Minor | io | Harsh J | Ryan P
YARN-3090 | DeletionService can silently ignore deletion task failures | Major | nodemanager | Jason Lowe | Varun Saxena
YARN-2809 | Implement workaround for linux kernel panic when removing cgroup | Major | nodemanager | Nathan Roberts | Nathan Roberts
HADOOP-10953 | NetworkTopology#add calls NetworkTopology#toString without holding the netlock | Minor | net | Liang Xie | Liang Xie
YARN-2246 | Job History Link in RM UI is redirecting to the URL which contains Job Id twice | Major | webapp | Devaraj K | Devaraj K
HDFS-7753 | Fix Multithreaded correctness Warnings in BackupImage.java | Major | . | Rakesh R | Konstantin Shvachko
YARN-3160 | Non-atomic operation on nodeUpdateQueue in RMNodeImpl | Major | resourcemanager | Chengbing Liu | Chengbing Liu
YARN-3074 | Nodemanager dies when localizer runner tries to write to a full disk | Major | nodemanager | Jason Lowe | Varun Saxena
YARN-3151 | On Failover tracking url wrong in application cli for KILLED application | Minor | client, resourcemanager | Bibin A Chundatt | Rohith Sharma K S
YARN-1237 | Description for yarn.nodemanager.aux-services in yarn-default.xml is misleading | Minor | documentation | Hitesh Shah | Brahma Reddy Battula
YARN-1580 | Documentation error regarding “container-allocation.expiry-interval-ms” | Trivial | documentation | German Florez-Larrahondo | Brahma Reddy Battula
HDFS-7704 | DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out. | Major | datanode, namenode | Rushabh S Shah | Rushabh S Shah
MAPREDUCE-6221 | Stringifier is left unclosed in Chain#getChainElementConf() | Minor | . | Ted Yu | Ted Yu
HADOOP-11587 | TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root | Trivial | test | Xiaoyu Yao | Xiaoyu Yao
YARN-3104 | RM generates new AMRM tokens every heartbeat between rolling and activation | Critical | resourcemanager | Jason Lowe | Jason Lowe
YARN-3191 | Log object should be initialized with its own class | Trivial | nodemanager | Rohith Sharma K S | Rohith Sharma K S
HADOOP-11497 | Fix typo in ClusterSetup.html#Hadoop_Startup | Major | documentation | Christian Winkler | Christian Winkler
YARN-3164 | rmadmin command usage prints incorrect command name | Minor | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
YARN-2847 | Linux native container executor segfaults if default banned user detected | Major | nodemanager | Jason Lowe | Olaf Flebbe
HADOOP-11467 | KerberosAuthenticator can connect to a non-secure cluster | Critical | security | Robert Kanter | Yongjun Zhang
HDFS-7686 | Re-add rapid rescan of possibly corrupt block feature to the block scanner | Blocker | . | Rushabh S Shah | Colin P. McCabe
HDFS-7778 | Rename FsVolumeListTest to TestFsVolumeList and commit it to branch-2 | Major | datanode, test | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-2899 | Run TestDockerContainerExecutorWithMocks on Linux only | Minor | nodemanager, test | Ming Ma | Ming Ma
YARN-2749 | Some testcases from TestLogAggregationService fails in trunk | Major | . | Xuan Gong | Xuan Gong
MAPREDUCE-6225 | Fix new findbug warnings in hadoop-mapreduce-client-core | Major | . | Jason Lowe | Varun Saxena
HDFS-7798 | Checkpointing failure caused by shared KerberosAuthenticator | Critical | security | Chengbing Liu | Chengbing Liu
HADOOP-11000 | HAServiceProtocol’s health state is incorrectly transitioned to SERVICE_NOT_RESPONDING | Major | . | Ming Ma | Ming Ma
HDFS-6662 | WebHDFS cannot open a file if its path contains “%” | Critical | namenode | Brahma Reddy Battula | Gerson Carlos
HADOOP-11295 | RPC Server Reader thread can’t shutdown if RPCCallQueue is full | Major | . | Ming Ma | Ming Ma
MAPREDUCE-4286 | TestClientProtocolProviderImpls passes on failure conditions | Major | . | Devaraj K | Devaraj K
HADOOP-11545 | ArrayIndexOutOfBoundsException is thrown with “hadoop credential list -provider” | Minor | security | Brahma Reddy Battula | Brahma Reddy Battula
MAPREDUCE-6261 | NullPointerException if MapOutputBuffer.flush invoked twice | Major | mrv2 | Jason Lowe | Tsuyoshi Ozawa
YARN-1615 | Fix typos in description about delay scheduling | Trivial | documentation, scheduler | Akira Ajisaka | Akira Ajisaka
HADOOP-11595 | Add default implementation for AbstractFileSystem#truncate | Major | fs | Yi Liu | Yi Liu
HADOOP-9087 | Queue size metric for metric sinks isn’t actually maintained | Minor | metrics | Mostafa Elhemali | Akira Ajisaka
YARN-933 | Potential InvalidStateTransitonException: Invalid event: LAUNCHED at FINAL_SAVING | Major | resourcemanager | J.Andreina | Rohith Sharma K S
HDFS-7788 | Post-2.6 namenode may not start up with an image containing inodes created with an old release. | Blocker | . | Kihwal Lee | Rushabh S Shah
YARN-3194 | RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node | Blocker | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HADOOP-11604 | Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. | Critical | net | Liang Xie | Chris Nauroth
YARN-3237 | AppLogAggregatorImpl fails to log error cause | Major | . | Rushabh S Shah | Rushabh S Shah
HDFS-7813 | TestDFSHAAdminMiniCluster#testFencer testcase is failing frequently | Major | ha, test | Rakesh R | Rakesh R
YARN-3238 | Connection timeouts to nodemanagers are retried at multiple levels | Blocker | . | Jason Lowe | Jason Lowe
YARN-3207 | secondary filter matches entites which do not have the key being filtered for. | Major | timelineserver | Prakash Ramachandran | Zhijie Shen
HDFS-7009 | Active NN and standby NN have different live nodes | Major | datanode | Ming Ma | Ming Ma
HADOOP-8642 | Document that io.native.lib.available only controls native bz2 and zlib compression codecs | Major | documentation, native | Eli Collins | Akira Ajisaka
HDFS-7807 | libhdfs htable.c: fix htable resizing, add unit test | Major | native | Colin P. McCabe | Colin P. McCabe
HDFS-7805 | NameNode recovery prompt should be printed on console | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore
HADOOP-11619 | FTPFileSystem should override getDefaultPort | Major | fs | Gera Shegalov | Brahma Reddy Battula
HDFS-7008 | xlator should be closed upon exit from DFSAdmin#genericRefresh() | Minor | . | Ted Yu | Tsuyoshi Ozawa
HDFS-7831 | Fix the starting index and end condition of the loop in FileDiffList.findEarlierSnapshotBlocks() | Major | . | Konstantin Shvachko | Konstantin Shvachko
MAPREDUCE-2815 | JavaDoc does not generate correctly for MultithreadedMapRunner | Minor | documentation | Shane Butler | Chris Palmer
HDFS-7763 | fix zkfc hung issue due to not catching exception in a corner case | Major | ha | Liang Xie | Liang Xie
HADOOP-11480 | Typo in hadoop-aws/index.md uses wrong scheme for test.fs.s3.name | Minor | documentation | Ted Yu | Ted Yu
YARN-3239 | WebAppProxy does not support a final tracking url which has query fragments and params | Major | . | Hitesh Shah | Jian He
HADOOP-11629 | WASB filesystem should not start BandwidthGaugeUpdater if fs.azure.skip.metrics set to true | Major | tools | shanyu zhao | shanyu zhao
HDFS-7495 | Remove updatePosition argument from DFSInputStream#getBlockAt() | Minor | . | Ted Yu | Colin P. McCabe
YARN-3256 | TestClientToAMTokens#testClientTokenRace is not running against all Schedulers even when using ParameterizedSchedulerTestBase | Major | . | Anubhav Dhoot | Anubhav Dhoot
HADOOP-9922 | hadoop windows native build will fail in 32 bit machine | Major | build, native | Vinayakumar B | Kiran Kumar M R
HDFS-7774 | Unresolved symbols error while compiling HDFS on Windows 7/32 bit | Critical | build, native | Venkatasubramaniam Ramakrishnan | Kiran Kumar M R
YARN-3255 | RM, NM, JobHistoryServer, and WebAppProxyServer’s main() should support generic options | Major | nodemanager, resourcemanager | Konstantin Shvachko | Konstantin Shvachko
HDFS-6753 | Initialize checkDisk when DirectoryScanner not able to get files list for scanning | Major | . | J.Andreina | J.Andreina
HDFS-7769 | TestHDFSCLI create files in hdfs project root dir | Trivial | test | Tsz Wo Nicholas Sze |
HADOOP-11634 | Description of webhdfs’ principal/keytab should switch places each other | Major | documentation | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-11615 | Update ServiceLevelAuth.md for YARN | Minor | documentation | Akira Ajisaka | Brahma Reddy Battula
YARN-3281 | Add RMStateStore to StateMachine visualization list | Minor | scripts | Chengbing Liu | Chengbing Liu
HDFS-7785 | Improve diagnostics information for HttpPutFailedException | Major | namenode | Chengbing Liu | Chengbing Liu
YARN-3270 | node label expression not getting set in ApplicationSubmissionContext | Minor | . | Rohit Agarwal | Rohit Agarwal
HADOOP-11449 | [JDK8] Cannot build on Windows: error: unexpected end tag: </ul> | Major | build | Alec Taylor | Chris Nauroth
HADOOP-11605 | FilterFileSystem#create with ChecksumOpt should propagate it to wrapped FS | Minor | fs | Gera Shegalov | Gera Shegalov
HDFS-7871 | NameNodeEditLogRoller can keep printing “Swallowing exception” message | Critical | . | Jing Zhao | Jing Zhao
MAPREDUCE-6268 | Fix typo in Task Attempt API’s URL | Minor | . | Ryu Kobayashi | Ryu Kobayashi
YARN-3222 | RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order | Critical | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HDFS-7682 | {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content | Major | . | Charles Lamb | Charles Lamb
HADOOP-11666 | Revert the format change of du output introduced by HADOOP-6857 | Major | . | Akira Ajisaka | Byron Wong
HDFS-7869 | Inconsistency in the return information while performing rolling upgrade | Major | . | J.Andreina | J.Andreina
HDFS-7879 | hdfs.dll does not export functions of the public libhdfs API | Major | build, libhdfs | Chris Nauroth | Chris Nauroth
YARN-3131 | YarnClientImpl should check FAILED and KILLED state in submitApplication | Major | . | Chang Li | Chang Li
HDFS-1522 | Merge Block.BLOCK_FILE_PREFIX and DataStorage.BLOCK_FILE_PREFIX into one constant | Major | datanode | Konstantin Shvachko | Dongming Liang
YARN-3231 | FairScheduler: Changing queueMaxRunningApps interferes with pending jobs | Critical | . | Siqi Li | Siqi Li
YARN-3242 | Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client | Critical | resourcemanager | zhihai xu | zhihai xu
MAPREDUCE-6136 | MRAppMaster doesn’t shutdown file systems | Major | applicationmaster | Noah Watkins | Brahma Reddy Battula
HADOOP-11674 | oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static | Critical | io | Sean Busbey | Sean Busbey
HDFS-7885 | Datanode should not trust the generation stamp provided by client | Critical | datanode | vitthal (Suhas) Gogate | Tsz Wo Nicholas Sze
YARN-3227 | Timeline renew delegation token fails when RM user’s TGT is expired | Critical | . | Jonathan Eagles | Zhijie Shen
HDFS-7818 | OffsetParam should return the default value instead of throwing NPE when the value is unspecified | Blocker | webhdfs | Eric Payne | Eric Payne
YARN-3275 | CapacityScheduler: Preemption happening on non-preemptable queues | Major | . | Eric Payne | Eric Payne
YARN-3296 | yarn.nodemanager.container-monitor.process-tree.class is configurable but ResourceCalculatorProcessTree class is marked Private | Major | . | Hitesh Shah | Hitesh Shah
MAPREDUCE-5657 | [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments | Minor | documentation | Andrew Purtell | Akira Ajisaka
HADOOP-11602 | Fix toUpperCase/toLowerCase to use Locale.ENGLISH | Blocker | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa
HADOOP-11686 | MiniKDC cannot change ORG_NAME or ORG_DOMAIN | Major | security, test | Duo Zhang | Duo Zhang
YARN-3287 | TimelineClient kerberos authentication failure uses wrong login context. | Major | . | Jonathan Eagles | Daryn Sharp
HADOOP-11571 | Über-jira: S3a stabilisation phase I | Blocker | fs/s3 | Steve Loughran | Steve Loughran
MAPREDUCE-6263 | Configurable timeout between YARNRunner terminate the application and forcefully kill. | Major | client | Jason Lowe | Eric Payne
MAPREDUCE-4742 | Fix typo in nnbench#displayUsage | Trivial | test | Liang Xie | Liang Xie
HADOOP-11618 | DelegateToFileSystem erroneously uses default FS’s port in constructor | Major | fs | Gera Shegalov | Brahma Reddy Battula
HDFS-7830 | DataNode does not release the volume lock when adding a volume fails. | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-3295 | Fix documentation nits found in markdown conversion | Trivial | documentation | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11693 | Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. | Major | tools | Duo Xu | Duo Xu
HDFS-7880 | Remove the tests for legacy Web UI in branch-2 | Blocker | test | Akira Ajisaka | Brahma Reddy Battula
YARN-3338 | Exclude jline dependency from YARN | Blocker | build | Zhijie Shen | Zhijie Shen
HDFS-6833 | DirectoryScanner should not register a deleting block with memory of DataNode | Critical | datanode | Shinichi Yamashita | Shinichi Yamashita
HDFS-7722 | DataNode#checkDiskError should also remove Storage when error is found. | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-3267 | Timelineserver applies the ACL rules after applying the limit on the number of records | Major | . | Prakash Ramachandran | Chang Li
HDFS-7926 | NameNode implementation of ClientProtocol.truncate(..) is not idempotent | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-2605 | CHANGES.txt has two “Release 0.21.1” sections | Major | documentation | Konstantin Shvachko | Allen Wittenauer
HADOOP-11558 | Fix dead links to doc of hadoop-tools | Minor | documentation | Masatake Iwasaki | Jean-Pierre Matsumoto
HDFS-7915 | The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error | Major | . | Colin P. McCabe | Colin P. McCabe
YARN-1453 | [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments | Minor | . | Andrew Purtell | Akira Ajisaka
HDFS-7886 | TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes | Minor | test | Yi Liu | Plamen Jeliazkov
HADOOP-11638 | OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux | Major | native | Dmitry Sivachenko | Kiran Kumar M R
HADOOP-11720 | [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools | Major | documentation | Akira Ajisaka | Akira Ajisaka
HADOOP-11722 | Some Instances of Services using ZKDelegationTokenSecretManager go down when old token cannot be deleted | Major | . | Arun Suresh | Arun Suresh
HDFS-7953 | NN Web UI fails to navigate to paths that contain # | Minor | namenode | Kanaka Kumar Avvaru | Kanaka Kumar Avvaru
MAPREDUCE-6277 | Job can post multiple history files if attempt loses connection to the RM | Major | mr-am | Chang Li | Chang Li
HDFS-7697 | Mark the PB OIV tool as experimental | Major | . | Haohui Mai | Lei (Eddy) Xu
HDFS-7945 | The WebHdfs system on DN does not honor the length parameter | Blocker | . | Haohui Mai | Haohui Mai
HDFS-7943 | Append cannot handle the last block with length greater than the preferred block size | Blocker | . | Jing Zhao | Jing Zhao
HDFS-7929 | inotify unable fetch pre-upgrade edit log segments once upgrade starts | Major | . | Zhe Zhang | Zhe Zhang
HDFS-7587 | Edit log corruption can happen if append fails with a quota violation | Blocker | namenode | Kihwal Lee | Jing Zhao
HADOOP-10703 | HttpServer2 creates multiple authentication filters | Major | security | Benoy Antony | Benoy Antony
HDFS-7816 | Unable to open webhdfs paths with “+” | Blocker | webhdfs | Jason Lowe | Haohui Mai
HADOOP-11729 | Fix link to cgroups doc in site.xml | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-7932 | Speed up the shutdown of datanode during rolling upgrade | Major | . | Kihwal Lee | Kihwal Lee
MAPREDUCE-6275 | Race condition in FileOutputCommitter v2 for user-specified task output subdirs | Critical | . | Siqi Li | Gera Shegalov
HDFS-7930 | commitBlockSynchronization() does not remove locations | Blocker | namenode | Konstantin Shvachko | Yi Liu
YARN-3369 | Missing NullPointer check in AppSchedulingInfo causes RM to die | Blocker | resourcemanager | Giovanni Matteo Fumarola | Brahma Reddy Battula
HDFS-7957 | Truncate should verify quota before making changes | Critical | namenode | Jing Zhao | Jing Zhao
HDFS-6841 | Use Time.monotonicNow() wherever applicable instead of Time.now() | Major | . | Vinayakumar B | Vinayakumar B
YARN-3384 | TestLogAggregationService.verifyContainerLogs fails after YARN-2777 | Minor | . | Naganarasimha G R | Naganarasimha G R
HDFS-7942 | NFS: support regexp grouping in nfs.exports.allowed.hosts | Major | nfs | Brandon Li | Brandon Li
YARN-3336 | FileSystem memory leak in DelegationTokenRenewer | Critical | resourcemanager | zhihai xu | zhihai xu
HDFS-7881 | TestHftpFileSystem#testSeek fails in branch-2 | Blocker | . | Akira Ajisaka | Brahma Reddy Battula
YARN-3393 | Getting application(s) goes wrong when app finishes before starting the attempt | Critical | timelineserver | Zhijie Shen | Zhijie Shen
HDFS-7884 | NullPointerException in BlockSender | Blocker | datanode | Tsz Wo Nicholas Sze | Brahma Reddy Battula
HDFS-7960 | The full block report should prune zombie storages even if they’re not empty | Critical | . | Lei (Eddy) Xu | Colin P. McCabe
HDFS-7956 | Improve logging for DatanodeRegistration. | Major | namenode | Konstantin Shvachko | Plamen Jeliazkov
HADOOP-11609 | Correct credential commands info in CommandsManual.html#credential | Major | documentation, security | Brahma Reddy Battula | Varun Saxena
MAPREDUCE-6285 | ClientServiceDelegate should not retry upon AuthenticationException | Major | . | Jonathan Eagles | Jonathan Eagles
HDFS-7961 | Trigger full block report after hot swapping disk | Major | . | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-7977 | NFS couldn’t take percentile intervals | Major | nfs | Brandon Li | Brandon Li
HADOOP-11014 | Potential resource leak in JavaKeyStoreProvider due to unclosed stream | Minor | security | Ted Yu | Tsuyoshi Ozawa
HADOOP-11738 | Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa
HDFS-7963 | Fix expected tracing spans in TestTracing along with HDFS-7054 | Critical | test | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11748 | The secrets of auth cookies should not be specified in configuration in clear text | Critical | . | Haohui Mai | Li Lu
HADOOP-11691 | X86 build of libwinutils is broken | Critical | build, native | Remus Rusanu | Kiran Kumar M R
HADOOP-11639 | Clean up Windows native code compilation warnings related to Windows Secure Container Executor. | Major | native | Chris Nauroth | Remus Rusanu
HDFS-7742 | favoring decommissioning node for replication can cause a block to stay underreplicated for long periods | Major | namenode | Nathan Roberts | Nathan Roberts
HADOOP-11761 | Fix findbugs warnings in org.apache.hadoop.security.authentication | Minor | . | Li Lu | Li Lu
HADOOP-11754 | RM fails to start in non-secure mode due to authentication filter failure | Blocker | . | Sangjin Lee | Haohui Mai
HDFS-7748 | Separate ECN flags from the Status in the DataTransferPipelineAck | Blocker | . | Haohui Mai | Anu Engineer
YARN-3304 | ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters | Blocker | nodemanager | Junping Du | Junping Du
HADOOP-11787 | OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac | Critical | native | Colin P. McCabe | Kiran Kumar M R
HDFS-8036 | Use snapshot path as source when using snapshot diff report in DistCp | Major | distcp | Sushmitha Sreenivasan | Jing Zhao
HADOOP-11757 | NFS gateway should shutdown when it can’t start UDP or TCP server | Major | nfs | Brandon Li | Brandon Li
HDFS-8001 | RpcProgramNfs3 : wrong parsing of dfs.blocksize | Trivial | nfs | Remi Catherinot | Remi Catherinot
MAPREDUCE-6303 | Read timeout when retrying a fetch error can be fatal to a reducer | Blocker | . | Jason Lowe | Jason Lowe
HDFS-7996 | After swapping a volume, BlockReceiver reports ReplicaNotFoundException | Critical | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-8051 | FsVolumeList#addVolume should release volume reference if not put it into BlockScanner. | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
HADOOP-11776 | jdiff is broken in Hadoop 2 | Blocker | . | Li Lu | Li Lu
HDFS-7999 | FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time | Major | . | zhouyingchao | zhouyingchao
HDFS-8072 | Reserved RBW space is not released if client terminates while writing block | Major | datanode | Arpit Agarwal | Arpit Agarwal
HDFS-8025 | Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated | Major | . | Ming Ma | Ming Ma
HADOOP-11815 | HttpServer2 should destroy SignerSecretProvider when it stops | Blocker | . | Rohith Sharma K S | Rohith Sharma K S
HDFS-8063 | Fix intermittent test failures in TestTracing | Minor | test | Masatake Iwasaki | Masatake Iwasaki
YARN-3055 | The token is not renewed properly if it’s shared by jobs (oozie) in DelegationTokenRenewer | Blocker | security | Yi Liu | Daryn Sharp
HADOOP-11837 | AuthenticationFilter should destroy SignerSecretProvider in Tomcat deployments | Blocker | security | Venkat Ranganathan | Bowen Zhang
HDFS-6672 | Regression with hdfs oiv tool | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu

### TESTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
YARN-1979 | TestDirectoryCollection fails when the umask is unusual | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
HADOOP-11165 | TestUTF8 fails when run against java 8 | Minor | test | Ted Yu | Stephen Chu
HDFS-7448 | TestBookKeeperHACheckpoints fails in trunk build | Minor | . | Ted Yu | Akira Ajisaka
YARN-2930 | TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 & 8 | Minor | . | Ted Yu | Wangda Tan
HDFS-7475 | Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic | Major | test | Xiaoyu Yao | Xiaoyu Yao
HADOOP-11358 | Tests for encryption/decryption with IV calculation overflow | Major | security, test | Yi Liu | Yi Liu
HADOOP-11125 | Remove redundant tests in TestOsSecureRandom | Major | . | Ted Yu | Masanori Oyama
HDFS-7585 | Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 | Major | test | sam liu | sam liu
YARN-3070 | TestRMAdminCLI#testHelp fails for transitionToActive command | Minor | . | Ted Yu | Junping Du
HADOOP-10668 | TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails | Major | test | Ted Yu | Ming Ma
HADOOP-11432 | Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2 | Major | fs | Liang Xie | Liang Xie
YARN-1537 | TestLocalResourcesTrackerImpl.testLocalResourceCache often failed | Major | nodemanager | Hong Shen | Xuan Gong
HDFS-7914 | TestJournalNode#testFailToStartWithBadConfig fails when the default dfs.journalnode.http-address port 8480 is in use | Major | . | Xiaoyu Yao | Xiaoyu Yao
HADOOP-11535 | TableMapping related tests failed due to ‘successful’ resolving of invalid test hostname | Minor | . | Kai Zheng | Kai Zheng

### SUB-TASKS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
YARN-2179 | Initial cache manager structure and context | Major | . | Chris Trezzo | Chris Trezzo
HDFS-7055 | Add tracing to DFSInputStream | Major | datanode, namenode | Colin P. McCabe | Colin P. McCabe
YARN-2180 | In-memory backing store for cache manager | Major | . | Chris Trezzo | Chris Trezzo
HDFS-7209 | Populate EDEK cache when creating encryption zone | Major | encryption, performance | Yi Liu | Yi Liu
HDFS-7254 | Add documentation for hot swaping DataNode drives | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-6877 | Avoid calling checkDisk when an HDFS volume is removed during a write. | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-6824 | Additional user documentation for HDFS encryption. | Minor | documentation | Andrew Wang | Andrew Wang
YARN-2183 | Cleaner service for cache manager | Major | . | Chris Trezzo | Chris Trezzo
HDFS-5928 | show namespace and namenode ID on NN dfshealth page | Major | . | Siqi Li | Siqi Li
YARN-2712 | TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks | Major | resourcemanager | Tsuyoshi Ozawa | Tsuyoshi Ozawa
HDFS-7035 | Make adding a new data directory to the DataNode an atomic operation and improve error handling | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-2186 | Node Manager uploader service for cache manager | Major | . | Chris Trezzo | Chris Trezzo
YARN-2236 | Shared Cache uploader service on the Node Manager | Major | . | Chris Trezzo | Chris Trezzo
YARN-2766 | ApplicationHistoryManager is expected to return a sorted list of apps/attempts/containers | Major | timelineserver | Robert Kanter | Robert Kanter
YARN-2690 | Make ReservationSystem and its dependent classes independent of Scheduler type | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot
HDFS-7413 | Some unit tests should use NameNodeProtocols instead of FSNameSystem | Major | test | Haohui Mai | Haohui Mai
HDFS-7415 | Move FSNameSystem.resolvePath() to FSDirectory | Major | . | Haohui Mai | Haohui Mai
YARN-2375 | Allow enabling/disabling timeline server per framework | Major | . | Jonathan Eagles | Mit Desai
HDFS-7420 | Delegate permission checks to FSDirectory | Major | . | Haohui Mai | Haohui Mai
HDFS-7412 | Move RetryCache to NameNodeRpcServer | Major | . | Haohui Mai | Haohui Mai
YARN-1984 | LeveldbTimelineStore does not handle db exceptions properly | Major | . | Jason Lowe | Varun Saxena
YARN-2404 | Remove ApplicationAttemptState and ApplicationState class in RMStateStore class | Major | . | Jian He | Tsuyoshi Ozawa
YARN-2188 | Client service for cache manager | Major | . | Chris Trezzo | Chris Trezzo
HDFS-7440 | Consolidate snapshot related operations in a single class | Major | . | Haohui Mai | Haohui Mai
HDFS-6803 | Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context | Major | hdfs-client | stack | stack
HDFS-7310 | Mover can give first priority to local DN if it has target storage type available in local DN | Major | balancer & mover | Uma Maheswara Rao G | Vinayakumar B
YARN-2165 | Timeline server should validate the numeric configuration values | Major | timelineserver | Karam Singh | Vasanth kumar RJ
YARN-2765 | Add leveldb-based implementation for RMStateStore | Major | resourcemanager | Jason Lowe | Jason Lowe
HDFS-7450 | Consolidate the implementation of GetFileInfo(), GetListings() and GetContentSummary() into a single class | Major | . | Haohui Mai | Haohui Mai
HDFS-7438 | Consolidate the implementation of rename() into a single class | Major | . | Haohui Mai | Haohui Mai
HDFS-7462 | Consolidate implementation of mkdirs() into a single class | Major | . | Haohui Mai | Haohui Mai
YARN-2880 | Add a test in TestRMRestart to make sure node labels will be recovered if it is enabled | Major | resourcemanager | Wangda Tan | Rohith Sharma K S
HDFS-7468 | Moving verify* functions to corresponding classes | Major | . | Li Lu | Li Lu
YARN-2056 | Disable preemption at Queue level | Major | resourcemanager | Mayank Bansal | Eric Payne
HDFS-7474 | Avoid resolving path in FSPermissionChecker | Major | namenode | Jing Zhao | Jing Zhao
HDFS-7459 | Consolidate cache-related implementation in FSNamesystem into a single class | Major | . | Haohui Mai | Haohui Mai
HDFS-7476 | Consolidate ACL-related operations to a single class | Major | namenode | Haohui Mai | Haohui Mai
YARN-2927 | InMemorySCMStore properties are inconsistent | Major | . | Ray Chiang | Ray Chiang
HDFS-7486 | Consolidate XAttr-related implementation into a single class | Major | . | Haohui Mai | Haohui Mai
HADOOP-10476 | Bumping the findbugs version to 3.0.0 | Major | build | Haohui Mai | Haohui Mai
HADOOP-11367 | Fix warnings from findbugs 3.0 in hadoop-streaming | Major | . | Li Lu | Li Lu
HADOOP-11369 | Fix new findbugs warnings in hadoop-mapreduce-client, non-core directories | Major | . | Li Lu | Li Lu
HADOOP-11372 | Fix new findbugs warnings in mapreduce-examples | Major | . | Li Lu | Li Lu
HDFS-7498 | Simplify the logic in INodesInPath | Major | namenode | Jing Zhao | Jing Zhao
HADOOP-11379 | Fix new findbugs warnings in hadoop-auth* | Major | . | Li Lu | Li Lu
HADOOP-11378 | Fix new findbugs warnings in hadoop-kms | Major | . | Li Lu | Li Lu
YARN-2924 | Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI | Major | client | Wangda Tan | Wangda Tan
HADOOP-11381 | Fix findbugs warnings in hadoop-distcp, hadoop-aws, hadoop-azure, and hadoop-openstack | Major | . | Li Lu | Li Lu
HADOOP-10482 | Fix various findbugs warnings in hadoop-common | Major | . | Haohui Mai | Haohui Mai
HADOOP-11389 | Clean up byte to string encoding issues in hadoop-common | Major | . | Haohui Mai | Haohui Mai
HDFS-7509 | Avoid resolving path multiple times | Major | . | Jing Zhao | Jing Zhao
HDFS-7506 | Consolidate implementation of setting inode attributes into a single class | Major | . | Haohui Mai | Haohui Mai
YARN-2914 | Potential race condition in Singleton implementation of SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetrics | Minor | . | Ted Yu | Varun Saxena
YARN-2762 | RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM | Minor | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
YARN-2189 | Admin service for cache manager | Major | . | Chris Trezzo | Chris Trezzo
HDFS-7528 | Consolidate symlink-related implementation into a single class | Major | . | Haohui Mai | Haohui Mai
YARN-2944 | InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance | Minor | . | Chris Trezzo | Chris Trezzo
YARN-2203 | Web UI for cache manager | Major | . | Chris Trezzo | Chris Trezzo
HDFS-7543 | Avoid path resolution when getting FileStatus for audit logs | Major | . | Haohui Mai | Haohui Mai
YARN-2738 | Add FairReservationSystem for FairScheduler | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot
HADOOP-11429 | Findbugs warnings in hadoop extras | Major | . | Varun Saxena | Varun Saxena
YARN-2920 | CapacityScheduler should be notified when labels on nodes changed | Major | . | Wangda Tan | Wangda Tan
YARN-2970 | NodeLabel operations in RMAdmin CLI get missing in help command. | Minor | api, client, resourcemanager | Junping Du | Varun Saxena
HADOOP-11370 | Fix new findbug warnings hadoop-yarn | Major | . | Zhijie Shen |
YARN-2943 | Add a node-labels page in RM web UI | Major | resourcemanager | Wangda Tan | Wangda Tan
YARN-2998 | Abstract out scheduler independent PlanFollower components | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot
YARN-2881 | Implement PlanFollower for FairScheduler | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot
HADOOP-10651 | Add ability to restrict service access using IP addresses and hostnames | Major | security | Benoy Antony | Benoy Antony
HDFS-7589 | Break the dependency between libnative_mini_dfs and libhdfs | Major | libhdfs | Zhanwei Wang | Zhanwei Wang
YARN-3014 | Replaces labels on a host should update all NM’s labels on that host | Major | . | Wangda Tan | Wangda Tan
HADOOP-11465 | Fix findbugs warnings in hadoop-gridmix | Major | . | Varun Saxena | Varun Saxena
HDFS-7056 | Snapshot support for truncate | Major | namenode | Konstantin Shvachko | Plamen Jeliazkov
YARN-3019 | Make work-preserving-recovery the default mechanism for RM recovery | Major | resourcemanager | Jian He | Jian He
YARN-2807 | Option “–forceactive” not works as described in usage of “yarn rmadmin -transitionToActive” | Minor | documentation, resourcemanager | Wangda Tan | Masatake Iwasaki
HDFS-5782 | BlockListAsLongs should take lists of Replicas rather than concrete classes | Minor | datanode | David Powell | Joe Pallas
YARN-2217 | Shared cache client side changes | Major | . | Chris Trezzo | Chris Trezzo
HDFS-7189 | Add trace spans for DFSClient metadata operations | Major | datanode, namenode | Colin P. McCabe | Colin P. McCabe
YARN-2984 | Metrics for container’s actual memory usage | Major | nodemanager | Karthik Kambatla | Karthik Kambatla
HDFS-7573 | Consolidate the implementation of delete() into a single class | Major | . | Haohui Mai | Haohui Mai
HDFS-5631 | Expose interfaces required by FsDatasetSpi implementations | Minor | datanode | David Powell | Joe Pallas
YARN-2933 | Capacity Scheduler preemption policy should only consider capacity without labels temporarily | Major | capacityscheduler | Wangda Tan | Mayank Bansal
HDFS-7638 | Small fix and few refinements for FSN#truncate | Major | datanode, namenode | Yi Liu | Yi Liu
HDFS-7634 | Disallow truncation of Lazy persist files | Major | datanode, namenode | Yi Liu | Yi Liu
HDFS-7623 | Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace | Major | . | Yi Liu | Yi Liu
HDFS-7643 | Test case to ensure lazy persist files cannot be truncated | Major | test | Arpit Agarwal | Yi Liu
YARN-2800 | Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature | Major | client, resourcemanager | Wangda Tan | Wangda Tan
HDFS-7659 | We should check the new length of truncate can’t be a negative value. | Major | datanode, namenode | Yi Liu | Yi Liu
HDFS-7676 | Fix TestFileTruncate to avoid bug of HDFS-7611 | Major | test | Konstantin Shvachko | Konstantin Shvachko
YARN-3092 | Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan
YARN-3011 | NM dies because of the failure of resource localization | Major | nodemanager | Wang Hao | Varun Saxena
YARN-3028 | Better syntax for replaceLabelsOnNode in RMAdmin CLI | Major | api, client, resourcemanager | Jian He | Rohith Sharma K S
HDFS-7677 | DistributedFileSystem#truncate should resolve symlinks | Major | datanode, namenode | Yi Liu | Yi Liu
HADOOP-11317 | Increment SLF4J version to 1.7.10 | Major | build | Steve Loughran | Tim Robertson
HDFS-6673 | Add delimited format support to PB OIV tool | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-7681 | Fix ReplicaInputStream constructor to take InputStreams | Major | datanode | Joe Pallas | Joe Pallas
HADOOP-10574 | Bump the maven plugin versions too -moving the numbers into properties | Major | build | Steve Loughran | Akira Ajisaka
YARN-3099 | Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan
YARN-3098 | Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues | Major | capacityscheduler | Wangda Tan | Wangda Tan
YARN-3075 | NodeLabelsManager implementation to retrieve label to node mapping | Major | resourcemanager | Varun Saxena | Varun Saxena
YARN-2543 | Resource usage should be published to the timeline server as well | Major | timelineserver | Zhijie Shen | Naganarasimha G R
YARN-1723 | AMRMClientAsync missing blacklist addition and removal functionality | Major | . | Bikas Saha | Bartosz Ługowski
HDFS-7655 | Expose truncate API for Web HDFS | Major | datanode, namenode | Yi Liu | Yi Liu
YARN-1904 | Uniform the XXXXNotFound messages from ClientRMService and ApplicationHistoryClientService | Major | . | Zhijie Shen | Zhijie Shen
YARN-2694 | Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY | Major | capacityscheduler, resourcemanager | Wangda Tan | Wangda Tan
HDFS-7720 | Quota by Storage Type API, tools and ClientNameNode Protocol changes | Major | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao
HDFS-7738 | Add more tests for truncate | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
YARN-2971 | RM uses conf instead of token service address to renew timeline delegation tokens | Major | timelineserver | Jonathan Eagles | Jonathan Eagles
HDFS-7058 | Tests for truncate CLI | Major | test | Konstantin Shvachko | Dasha Boudnik
YARN-2616 | Add CLI client to the registry to list, view and manipulate entries | Major | client | Steve Loughran | Akshay Radia
YARN-2683 | registry config options: document and move to core-default | Major | api, resourcemanager | Steve Loughran | Steve Loughran
HDFS-7760 | Document truncate for WebHDFS. | Minor | documentation | Yi Liu | Konstantin Shvachko
HDFS-7723 | Quota By Storage Type namenode implemenation | Major | namenode | Xiaoyu Yao | Xiaoyu Yao
YARN-2079 | Recover NonAggregatingLogHandler state upon nodemanager restart | Major | nodemanager | Jason Lowe | Jason Lowe
YARN-3124 | Capacity Scheduler LeafQueue/ParentQueue should use QueueCapacities to track capacities-by-label | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan
YARN-2994 | Document work-preserving RM restart | Major | resourcemanager | Jian He | Jian He
HDFS-7776 | Adding additional unit tests for Quota By Storage Type | Major | test | Xiaoyu Yao | Xiaoyu Yao
HDFS-4265 | BKJM doesn’t take advantage of speculative reads | Major | ha | Ivan Kelly | Rakesh R
HDFS-7775 | Use consistent naming for NN-internal quota related types and functions | Minor | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao
HADOOP-11600 | Fix up source codes to be compiled with Guava 17.0 | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa
HDFS-4266 | BKJM: Separate write and ack quorum | Major | ha | Ivan Kelly | Rakesh R
HADOOP-11570 | S3AInputStream.close() downloads the remaining bytes of the object from S3 | Major | fs/s3 | Dan Hecht | Dan Hecht
HADOOP-11522 | Update S3A Documentation | Major | fs/s3 | Thomas Demoor | Thomas Demoor
HADOOP-11521 | Make connection timeout configurable in s3a | Minor | fs/s3 | Thomas Demoor | Thomas Demoor
YARN-3132 | RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan
YARN-1514 | Utility to benchmark ZKRMStateStore#loadState for ResourceManager-HA | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa
HDFS-7656 | Expose truncate API for HDFS httpfs | Major | datanode, namenode | Yi Liu | Yi Liu
YARN-3076 | Add API/Implementation to YarnClient to retrieve label-to-node mapping | Major | client | Varun Saxena | Varun Saxena
HDFS-7814 | Fix usage string of storageType parameter for “dfsadmin -setSpaceQuota/clrSpaceQuota” | Minor | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao
HDFS-7740 | Test truncate with DataNodes restarting | Major | test | Konstantin Shvachko | Yi Liu
HADOOP-11584 | s3a file block size set to 0 in getFileStatus | Blocker | fs/s3 | Dan Hecht | Brahma Reddy Battula
HDFS-7806 | Refactor: move StorageType from hadoop-hdfs to hadoop-common | Minor | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao
HADOOP-10478 | Fix new findbugs warnings in hadoop-maven-plugins | Major | . | Haohui Mai | Li Lu
HDFS-7467 | Provide storage tier information for a directory via fsck | Major | balancer & mover | Benoy Antony | Benoy Antony
HDFS-7843 | A truncated file is corrupted after rollback from a rolling upgrade | Blocker | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-7819 | Log WARN message for the blocks which are not in Block ID based layout | Major | datanode | Rakesh R | Rakesh R
YARN-3265 | CapacityScheduler deadlock when computing absolute max avail capacity (fix for trunk/branch-2) | Blocker | capacityscheduler, resourcemanager | Wangda Tan | Wangda Tan
HADOOP-11183 | Memory-based S3AOutputstream | Major | fs/s3 | Thomas Demoor | Thomas Demoor
YARN-3122 | Metrics for container’s actual CPU usage | Major | nodemanager | Anubhav Dhoot | Anubhav Dhoot
HDFS-7746 | Add a test randomly mixing append, truncate and snapshot | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
YARN-2786 | Create yarn cluster CLI to enable list node labels collection | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan
HDFS-7855 | Separate class Packet from DFSOutputStream | Major | hdfs-client | Li Bo | Li Bo
YARN-1809 | Synchronize RM and Generic History Service Web-UIs | Major | . | Zhijie Shen | Xuan Gong
HADOOP-11670 | Regression: s3a auth setup broken | Blocker | fs/s3 | Adam Budde | Adam Budde
YARN-3300 | outstanding_resource_requests table should not be shown in AHS | Major | resourcemanager | Xuan Gong | Xuan Gong
YARN-1884 | ContainerReport should have nodeHttpAddress | Major | . | Zhijie Shen | Xuan Gong
HADOOP-11710 | Make CryptoOutputStream behave like DFSOutputStream wrt synchronization | Critical | fs | Sean Busbey | Sean Busbey
HDFS-7903 | Cannot recover block after truncate and delete snapshot | Blocker | datanode, namenode | Tsz Wo Nicholas Sze | Plamen Jeliazkov
YARN-3171 | Sort by Application id, AppAttempt & ContainerID doesn’t work in ATS / RM web ui | Minor | timelineserver | Jeff Zhang | Naganarasimha G R
HDFS-7838 | Expose truncate API for libhdfs | Major | datanode, namenode | Yi Liu | Yi Liu
HDFS-7940 | Add tracing to DFSClient#setQuotaByStorageType | Major | hdfs-client | Rakesh R | Rakesh R
HDFS-7946 | TestDataNodeVolumeFailureReporting NPE on Windows | Major | test | Xiaoyu Yao | Xiaoyu Yao
HDFS-7948 | TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows | Major | test | Xiaoyu Yao | Xiaoyu Yao
HDFS-7950 | Fix TestFsDatasetImpl#testAddVolumes failure on Windows | Major | test | Xiaoyu Yao | Xiaoyu Yao
HDFS-7951 | Fix NPE for TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on Linux | Major | test | Xiaoyu Yao | Xiaoyu Yao
HDFS-7054 | Make DFSOutputStream tracing more fine-grained | Major | datanode, namenode | Colin P. McCabe | Colin P. McCabe
YARN-3379 | Missing data in localityTable and ResourceRequests table in RM WebUI | Major | resourcemanager, webapp, yarn | Xuan Gong | Xuan Gong
HDFS-7824 | GetContentSummary API and its namenode implementation for Storage Type Quota/Usage | Major | datanode, namenode | Xiaoyu Yao | Xiaoyu Yao
HDFS-7700 | Document quota support for storage types | Major | documentation | Xiaoyu Yao | Xiaoyu Yao
HDFS-7954 | TestBalancer#testBalancerWithPinnedBlocks failed on Windows | Minor | test | Xiaoyu Yao | Xiaoyu Yao
HDFS-7811 | Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage | Minor | namenode | Xiaoyu Yao | Xiaoyu Yao
HDFS-8039 | Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows | Minor | test | Xiaoyu Yao | Xiaoyu Yao
HADOOP-11377 | jdiff failing on java 7 and java 8, “Null.java” not found | Major | build | Steve Loughran | Tsuyoshi Ozawa
YARN-3430 | RMAppAttempt headroom data is missing in RM Web UI | Blocker | resourcemanager, webapp, yarn | Xuan Gong | Xuan Gong
HDFS-8038 | PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format. | Minor | tools | Xiaoyu Yao | Xiaoyu Yao
HADOOP-11796 | Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows | Minor | test | Xiaoyu Yao | Xiaoyu Yao

### OTHER:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-2486 | Review issues with UnderReplicatedBlocks | Minor | namenode | Steve Loughran | Uma Maheswara Rao G
YARN-2949 | Add documentation for CGroups | Major | documentation, nodemanager | Varun Vasudev | Varun Vasudev
HADOOP-11489 | Dropping dependency on io.netty from hadoop-nfs’ pom.xml | Minor | nfs | Ted Yu | Ted Yu
HADOOP-11463 | Replace method-local TransferManager object with S3AFileSystem#transfers | Major | fs/s3 | Ted Yu | Ted Yu
HADOOP-11612 | Workaround for Curator’s ChildReaper requiring Guava 15+ | Major | . | Robert Kanter | Robert Kanter
MAPREDUCE-6264 | Remove httpclient dependency from hadoop-mapreduce-client | Major | . | Akira Ajisaka | Brahma Reddy Battula
HADOOP-9329 | document native build dependencies in BUILDING.txt | Trivial | documentation | Colin P. McCabe | Vijay Bhat
YARN-2213 | Change proxy-user cookie log in AmIpFilter to DEBUG | Minor | . | Ted Yu | Varun Saxena