Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 3.1.0 - 2018-04-06

### INCOMPATIBLE CHANGES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-15008 | Metrics sinks may emit too frequently if multiple sink periods are configured | Minor | metrics | Erik Krogen | Erik Krogen
HDFS-12825 | Fsck report shows config key name for min replication issues | Minor | hdfs | Harshakiran Reddy | Gabor Bota
HDFS-12883 | RBF: Document Router and State Store metrics | Major | documentation | Yiqun Lin | Yiqun Lin
HDFS-12895 | RBF: Add ACL support for mount table | Major | . | Yiqun Lin | Yiqun Lin
YARN-7190 | Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath | Major | timelineclient, timelinereader, timelineserver | Vrushali C | Varun Saxena
HADOOP-13282 | S3 blob etags to be made visible in S3A status/getFileChecksum() calls | Minor | fs/s3 | Steve Loughran | Steve Loughran
HDFS-13099 | RBF: Use the ZooKeeper as the default State Store | Minor | documentation | Yiqun Lin | Yiqun Lin
YARN-7677 | Docker image cannot set HADOOP_CONF_DIR | Major | . | Eric Badger | Jim Brennan

### IMPORTANT ISSUES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-13083 | RBF: Fix doc error setting up client | Major | federation | tartarus | tartarus

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-15005 | Support meta tag element in Hadoop XML configurations | Major | . | Ajay Kumar | Ajay Kumar
YARN-3926 | [Umbrella] Extend the YARN resource model for easier resource-type management and profiles | Major | nodemanager, resourcemanager | Varun Vasudev | Varun Vasudev
HDFS-7877 | [Umbrella] Support maintenance state for datanodes | Major | datanode, namenode | Ming Ma | Ming Ma
HADOOP-13055 | Implement linkMergeSlash and linkFallback for ViewFileSystem | Major | fs, viewfs | Zhe Zhang | Manoj Govindassamy
YARN-6871 | Add additional deSelects params in RMWebServices#getAppReport | Major | resourcemanager, router | Giovanni Matteo Fumarola | Tanuj Nayak
HADOOP-14840 | Tool to estimate resource requirements of an application pipeline based on prior executions | Major | tools | Subru Krishnan | Rui Li
HDFS-206 | Support for head in FSShell | Minor | . | Olga Natkovich | Gabor Bota
YARN-5079 | [Umbrella] Native YARN framework layer for services and beyond | Major | . | Vinod Kumar Vavilapalli |
YARN-4757 | [Umbrella] Simplified discovery of services via DNS mechanisms | Major | . | Vinod Kumar Vavilapalli |
HADOOP-13786 | Add S3A committers for zero-rename commits to S3 endpoints | Major | fs/s3 | Steve Loughran | Steve Loughran
HDFS-9806 | Allow HDFS block replicas to be provided by an external storage system | Major | . | Chris Douglas |
YARN-6592 | [Umbrella] Rich placement constraints in YARN | Major | . | Konstantinos Karanasos |
HDFS-12998 | SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff | Major | snapshots | Shashikant Banerjee | Shashikant Banerjee
YARN-5764 | NUMA awareness support for launching containers | Major | nodemanager, yarn | Olasoji | Devaraj K
YARN-5983 | [Umbrella] Support for FPGA as a Resource in YARN | Major | yarn | Zhankun Tang | Zhankun Tang
YARN-6223 | [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN | Major | . | Wangda Tan | Wangda Tan
HADOOP-14898 | Create official Docker images for development and testing features | Major | . | Elek, Marton | Elek, Marton
HDFS-13553 | RBF: Support global quota | Major | . | Íñigo Goiri | Yiqun Lin

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
YARN-7022 | Improve click interaction in queue topology in new YARN UI | Major | yarn-ui-v2 | Abdullah Yousufi | Abdullah Yousufi
YARN-7033 | Add support for NM Recovery of assigned resources (e.g. GPU’s, NUMA, FPGA’s) to container | Major | nodemanager | Devaraj K | Devaraj K
HADOOP-14850 | Read HttpServer2 resources directly from the source tree (if exists) | Major | . | Elek, Marton | Elek, Marton
HADOOP-14849 | some wrong spelling words update | Trivial | . | Chen Hongfei | Chen Hongfei
HADOOP-14844 | Remove requirement to specify TenantGuid for MSI Token Provider | Major | fs/adl | Atul Sikaria | Atul Sikaria
YARN-7057 | FSAppAttempt#getResourceUsage doesn’t need to consider resources queued for preemption | Major | fairscheduler | Karthik Kambatla | Karthik Kambatla
HADOOP-14804 | correct wrong parameters format order in core-default.xml | Trivial | . | Chen Hongfei | Chen Hongfei
HADOOP-14864 | FSDataInputStream#unbuffer UOE should include stream class name | Minor | fs | John Zhuge | Bharat Viswanadham
HDFS-12441 | Suppress UnresolvedPathException in namenode log | Minor | . | Kihwal Lee | Kihwal Lee
HADOOP-13714 | Tighten up our compatibility guidelines for Hadoop 3 | Blocker | documentation | Karthik Kambatla | Daniel Templeton
HADOOP-7308 | Remove unused TaskLogAppender configurations from log4j.properties | Major | conf | Todd Lipcon | Todd Lipcon
YARN-7045 | Remove FSLeafQueue#addAppSchedulable | Major | fairscheduler | Yufei Gu | Sen Zhao
HDFS-12486 | GetConf to get journalnodeslist | Major | journal-node, shell | Bharat Viswanadham | Bharat Viswanadham
HDFS-12320 | Add quantiles for transactions batched in Journal sync | Major | metrics, namenode | Hanisha Koneru | Hanisha Koneru
HDFS-12516 | Suppress the fsnamesystem lock warning on nn startup | Major | . | Ajay Kumar | Ajay Kumar
HDFS-12304 | Remove unused parameter from FsDatasetImpl#addVolume | Minor | . | Chen Liang | Chen Liang
YARN-65 | Reduce RM app memory footprint once app has completed | Major | resourcemanager | Jason Lowe | Manikandan R
HDFS-5040 | Audit log for admin commands/ logging output of all DFS admin commands | Major | namenode | Raghu C Doppalapudi | Kuhu Shukla
HDFS-12560 | Remove the extra word “it” in HdfsUserGuide.md | Trivial | . | fang zhenyi | fang zhenyi
YARN-6333 | Improve doc for minSharePreemptionTimeout, fairSharePreemptionTimeout and fairSharePreemptionThreshold | Major | fairscheduler | Yufei Gu | Chetna Chaudhari
HDFS-12552 | Use slf4j instead of log4j in FSNamesystem | Major | . | Ajay Kumar | Ajay Kumar
HADOOP-14908 | CrossOriginFilter should trigger regex on more input | Major | common, security | Allen Wittenauer | Johannes Alberti
HDFS-12455 | WebHDFS - Adding “snapshot enabled” status to ListStatus query result. | Major | snapshots, webhdfs | Ajay Kumar | Ajay Kumar
HDFS-12420 | Add an option to disallow ‘namenode format -force’ | Major | . | Ajay Kumar | Ajay Kumar
YARN-2162 | add ability in Fair Scheduler to optionally configure maxResources in terms of percentage | Major | fairscheduler, scheduler | Ashwin Shankar | Yufei Gu
YARN-7207 | Cache the RM proxy server address | Major | RM | Yufei Gu | Yufei Gu
HADOOP-14920 | KMSClientProvider won’t work with KMS delegation token retrieved from non-Java client. | Major | kms | Xiaoyu Yao | Xiaoyu Yao
HADOOP-14184 | Remove service loader config entry for ftp fs | Minor | fs | John Zhuge | Sen Zhao
HDFS-12542 | Update javadoc and documentation for listStatus | Major | documentation | Ajay Kumar | Ajay Kumar
YARN-7359 | TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic | Minor | . | Haibo Chen | Haibo Chen
YARN-7261 | Add debug message for better download latency monitoring | Major | nodemanager | Yufei Gu | Yufei Gu
HDFS-12650 | Use slf4j instead of log4j in LeaseManager | Major | . | Ajay Kumar | Ajay Kumar
YARN-7357 | Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations | Trivial | resourcemanager | Daniel Templeton | Sen Zhao
YARN-4163 | Audit getQueueInfo and getApplications calls | Major | . | Chang Li | Chang Li
HADOOP-9657 | NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports | Minor | net | Steve Loughran | Varun Saxena
YARN-7397 | Reduce lock contention in FairScheduler#getAppWeight() | Major | fairscheduler | Daniel Templeton | Daniel Templeton
HDFS-7878 | API - expose a unique file identifier | Major | . | Sergey Shelukhin | Chris Douglas
YARN-6413 | FileSystem based Yarn Registry implementation | Major | amrmproxy, api, resourcemanager | Ellen Hui | Ellen Hui
HDFS-12771 | Add genstamp and block size to metasave Corrupt blocks list | Minor | . | Kuhu Shukla | Kuhu Shukla
HDFS-10528 | Add logging to successful standby checkpointing | Major | namenode | Xiaoyu Yao | Xiaoyu Yao
YARN-7401 | Reduce lock contention in ClusterNodeTracker#getClusterCapacity() | Major | resourcemanager | Daniel Templeton | Daniel Templeton
HDFS-7060 | Avoid taking locks when sending heartbeats from the DataNode | Major | . | Haohui Mai | Jiandan Yang
HADOOP-14872 | CryptoInputStream should implement unbuffer | Major | fs, security | John Zhuge | John Zhuge
YARN-7413 | Support resource type in SLS | Major | scheduler-load-simulator | Yufei Gu | Yufei Gu
HADOOP-14876 | Create downstream developer docs from the compatibility guidelines | Critical | documentation | Daniel Templeton | Daniel Templeton
YARN-7414 | FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight() | Minor | fairscheduler | Daniel Templeton | Soumabrata Chakraborty
HDFS-12814 | Add blockId when warning slow mirror/disk in BlockReceiver | Trivial | hdfs | Jiandan Yang | Jiandan Yang
HADOOP-13514 | Upgrade maven surefire plugin to 2.20.1 | Major | build | Ewan Higgs | Akira Ajisaka
YARN-7524 | Remove unused FairSchedulerEventLog | Major | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg
YARN-6851 | Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat | Minor | . | Wei Yan | Wei Yan
YARN-7495 | Improve robustness of the AggregatedLogDeletionService | Major | log-aggregation | Jonathan Eagles | Jonathan Eagles
HDFS-12594 | snapshotDiff fails if the report exceeds the RPC response limit | Major | hdfs | Shashikant Banerjee | Shashikant Banerjee
HDFS-12877 | Add open(PathHandle) with default buffersize | Trivial | . | Chris Douglas | Chris Douglas
HADOOP-14976 | Set HADOOP_SHELL_EXECNAME explicitly in scripts | Major | . | Arpit Agarwal | Arpit Agarwal
HADOOP-15039 | Move SemaphoredDelegatingExecutor to hadoop-common | Minor | fs, fs/oss, fs/s3 | Genmao Yu | Genmao Yu
YARN-6483 | Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM | Major | resourcemanager | Juan Rodríguez Hortalá | Juan Rodríguez Hortalá
HADOOP-15056 | Fix TestUnbuffer#testUnbufferException failure | Minor | test | Jack Bearden | Jack Bearden
HADOOP-15012 | Add readahead, dropbehind, and unbuffer to StreamCapabilities | Major | fs | John Zhuge | John Zhuge
HADOOP-15104 | AliyunOSS: change the default value of max error retry | Major | fs/oss | wujinhu | wujinhu
YARN-7274 | Ability to disable elasticity at leaf queue level | Major | capacityscheduler | Scott Brokaw | Zian Chen
HDFS-12882 | Support full open(PathHandle) contract in HDFS | Major | hdfs-client | Chris Douglas | Chris Douglas
YARN-7625 | Expose NM node/containers resource utilization in JVM metrics | Major | nodemanager | Weiwei Yang | Weiwei Yang
HADOOP-14914 | Change to a safely casting long to int. | Major | . | Yufei Gu | Ajay Kumar
HDFS-12910 | Secure Datanode Starter should log the port when it fails to bind | Minor | datanode | Stephen O’Donnell | Stephen O’Donnell
YARN-7642 | Add test case to verify context update after container promotion or demotion with or without auto update | Minor | nodemanager | Weiwei Yang | Weiwei Yang
YARN-5418 | When partial log aggregation is enabled, display the list of aggregated files on the container log page | Major | . | Siddharth Seth | Xuan Gong
HADOOP-15106 | FileSystem::open(PathHandle) should throw a specific exception on validation failure | Minor | . | Chris Douglas | Chris Douglas
HDFS-12818 | Support multiple storages in DataNodeCluster / SimulatedFSDataset | Minor | datanode, test | Erik Krogen | Erik Krogen
HDFS-12932 | Fix confusing LOG message for block replication | Minor | hdfs | Chao Sun | Chao Sun
HDFS-9023 | When NN is not able to identify DN for replication, reason behind it can be logged | Critical | hdfs-client, namenode | Surendra Singh Lilhore | Xiao Chen
YARN-7580 | ContainersMonitorImpl logged message lacks detail when exceeding memory limits | Major | nodemanager | Wilfred Spiegelenburg | Wilfred Spiegelenburg
HDFS-12351 | Explicitly describe the minimal number of DataNodes required to support an EC policy in EC document. | Minor | documentation, erasure-coding | Lei (Eddy) Xu | Hanisha Koneru
HDFS-12629 | NameNode UI should report total blocks count by type - replicated and erasure coded | Major | hdfs | Manoj Govindassamy | Manoj Govindassamy
YARN-7687 | ContainerLogAppender Improvements | Trivial | . | BELUGA BEHR |
YARN-7688 | Miscellaneous Improvements To ProcfsBasedProcessTree | Minor | nodemanager | BELUGA BEHR |
HDFS-11847 | Enhance dfsadmin listOpenFiles command to list files blocking datanode decommissioning | Major | hdfs | Manoj Govindassamy | Manoj Govindassamy
YARN-7678 | Ability to enable logging of container memory stats | Major | nodemanager | Jim Brennan | Jim Brennan
HDFS-11848 | Enhance dfsadmin listOpenFiles command to list files under a given path | Major | . | Manoj Govindassamy | Yiqun Lin
HDFS-12945 | Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods | Minor | . | Wei Yan | Wei Yan
HDFS-12808 | Add LOG.isDebugEnabled() guard for LOG.debug(“…”) | Minor | . | Mehran Hassani | Bharat Viswanadham
YARN-7722 | Rename variables in MockNM, MockRM for better clarity | Trivial | . | lovekesh bansal | lovekesh bansal
YARN-7622 | Allow fair-scheduler configuration on HDFS | Minor | fairscheduler, resourcemanager | Greg Phillips | Greg Phillips
HADOOP-15033 | Use java.util.zip.CRC32C for Java 9 and above | Major | performance, util | Dmitry Chuyko | Dmitry Chuyko
YARN-7590 | Improve container-executor validation check | Major | security, yarn | Eric Yang | Eric Yang
HADOOP-15157 | Zookeeper authentication related properties to support CredentialProviders | Minor | security | Gergo Repas | Gergo Repas
MAPREDUCE-7029 | FileOutputCommitter is slow on filesystems lacking recursive delete | Minor | . | Karthik Palaniappan | Karthik Palaniappan
HADOOP-15114 | Add closeStreams(…) to IOUtils | Major | . | Ajay Kumar | Ajay Kumar
MAPREDUCE-6984 | MR AM to clean up temporary files from previous attempt in case of no recovery | Major | applicationmaster | Gergo Repas | Gergo Repas
HDFS-13036 | Reusing the volume storage ID obtained by replicaInfo | Major | datanode | liaoyuxiangqin | liaoyuxiangqin
YARN-7755 | Clean up deprecation messages for allocation increments in FS config | Minor | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg
MAPREDUCE-7022 | Fast fail rogue jobs based on task scratch dir size | Major | task | Johan Gustavsson | Johan Gustavsson
YARN-2185 | Use pipes when localizing archives | Major | nodemanager | Jason Lowe | Miklos Szegedi
HDFS-13092 | Reduce verbosity for ThrottledAsyncChecker.java:schedule | Minor | datanode | Mukul Kumar Singh | Mukul Kumar Singh
HDFS-13062 | Provide support for JN to use separate journal disk per namespace | Major | federation, journal-node | Bharat Viswanadham | Bharat Viswanadham
HADOOP-15170 | Add symlink support to FileUtil#unTarUsingJava | Minor | util | Jason Lowe | Ajay Kumar
HADOOP-15168 | Add kdiag tool to hadoop command | Minor | . | Bharat Viswanadham | Bharat Viswanadham
HDFS-13073 | Cleanup code in InterQJournalProtocol.proto | Minor | journal-node | Bharat Viswanadham | Bharat Viswanadham
HADOOP-15212 | Add independent secret manager method for logging expired tokens | Major | security | Daryn Sharp | Daryn Sharp
YARN-7841 | Cleanup AllocationFileLoaderService’s reloadAllocations method | Minor | yarn | Szilard Nemeth | Szilard Nemeth
HDFS-12947 | Limit the number of Snapshots allowed to be created for a Snapshottable Directory | Major | snapshots | Shashikant Banerjee | Shashikant Banerjee
HDFS-12933 | Improve logging when DFSStripedOutputStream failed to write some blocks | Minor | erasure-coding | Xiao Chen | chencan
YARN-7728 | Expose container preemptions related information in Capacity Scheduler queue metrics | Major | . | Eric Payne | Eric Payne
YARN-7655 | Avoid AM preemption caused by RRs for specific nodes or racks | Major | fairscheduler | Steven Rand | Steven Rand
HADOOP-15187 | Remove ADL mock test dependency on REST call invoked from Java SDK | Major | fs/adl | Vishwajeet Dusane | Vishwajeet Dusane
MAPREDUCE-7048 | Uber AM can crash due to unknown task in statusUpdate | Major | mr-am | Peter Bacsko | Peter Bacsko
HADOOP-15195 | With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. | Major | build | Grigori Rybkine | Grigori Rybkine
HADOOP-14531 | [Umbrella] Improve S3A error handling & reporting | Blocker | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-15204 | Add Configuration API for parsing storage sizes | Minor | conf | Anu Engineer | Anu Engineer
HDFS-13142 | Define and Implement a DiifList Interface to store and manage SnapshotDiffs | Major | snapshots | Shashikant Banerjee | Shashikant Banerjee
HADOOP-13972 | ADLS to support per-store configuration | Major | fs/adl | John Zhuge | Sharad Sonker
HDFS-13153 | Enable HDFS diskbalancer by default | Major | diskbalancer | Ajay Kumar | Ajay Kumar
HADOOP-14875 | Create end user documentation from the compatibility guidelines | Critical | documentation | Daniel Templeton | Daniel Templeton
HADOOP-15070 | add test to verify FileSystem and paths differentiate on user info | Minor | fs, test | Steve Loughran | Steve Loughran
YARN-7813 | Capacity Scheduler Intra-queue Preemption should be configurable for each queue | Major | capacity scheduler, scheduler preemption | Eric Payne | Eric Payne
HDFS-13168 | XmlImageVisitor - Prefer Array over LinkedList | Minor | hdfs | BELUGA BEHR | BELUGA BEHR
HDFS-13167 | DatanodeAdminManager Improvements | Trivial | hdfs | BELUGA BEHR | BELUGA BEHR
HADOOP-15235 | Authentication Tokens should use HMAC instead of MAC | Major | security | Robert Kanter | Robert Kanter
HADOOP-12897 | KerberosAuthenticator.authenticate to include URL on IO failures | Minor | security | Steve Loughran | Ajay Kumar
HDFS-13175 | Add more information for checking argument in DiskBalancerVolume | Minor | diskbalancer | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-11187 | Optimize disk access for last partial chunk checksum of Finalized replica | Major | datanode | Wei-Chiu Chuang | Gabor Bota
HADOOP-15255 | Upper/Lower case conversion support for group names in LdapGroupsMapping | Major | . | Nanda kumar | Nanda kumar
HADOOP-13374 | Add the L&N verification script | Major | . | Xiao Chen | Allen Wittenauer
HADOOP-15178 | Generalize NetUtils#wrapException to handle other subclasses with String Constructor | Major | . | Ajay Kumar | Ajay Kumar
HDFS-13193 | Various Improvements for BlockTokenSecretManager | Trivial | hdfs | BELUGA BEHR | BELUGA BEHR
HADOOP-14959 | DelegationTokenAuthenticator.authenticate() to wrap network exceptions | Minor | net, security | Steve Loughran | Ajay Kumar
MAPREDUCE-7010 | Make Job History File Permissions configurable | Major | . | Andras Bokor | Gergely Novák
HDFS-13192 | Change the code order in getFileEncryptionInfo to avoid unnecessary call of assignment | Minor | encryption | LiXin Ge | LiXin Ge
MAPREDUCE-7061 | SingleCluster setup document needs to be updated | Major | . | Bharat Viswanadham | Bharat Viswanadham
HADOOP-15263 | hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake | Minor | build | Steve Loughran | Steve Loughran
HADOOP-15007 | Stabilize and document Configuration <tag> element | Blocker | conf | Steve Loughran | Ajay Kumar
HDFS-13102 | Implement SnapshotSkipList class to store Multi level DirectoryDiffs | Major | snapshots | Shashikant Banerjee | Shashikant Banerjee
HDFS-13202 | Fix the outdated javadocs in HAUtil | Trivial | . | Chao Sun | Chao Sun
YARN-5028 | RMStateStore should trim down app state for completed applications | Major | resourcemanager | Karthik Kambatla | Gergo Repas
HADOOP-15279 | increase maven heap size recommendations | Minor | build, documentation, test | Allen Wittenauer | Allen Wittenauer
HDFS-13171 | Handle Deletion of nodes in SnasphotSkipList | Major | snapshots | Shashikant Banerjee | Shashikant Banerjee
HADOOP-15252 | Checkstyle version is not compatible with IDEA’s checkstyle plugin | Major | . | Andras Bokor | Andras Bokor
HDFS-13173 | Replace ArrayList with DirectoryDiffList(SnapshotSkipList) to store DirectoryDiffs | Major | snapshots | Shashikant Banerjee | Shashikant Banerjee
HADOOP-15282 | HADOOP-15235 broke TestHttpFSServerWebServer | Major | test | Robert Kanter | Robert Kanter
HDFS-13170 | Port webhdfs unmaskedpermission parameter to HTTPFS | Major | . | Stephen O’Donnell | Stephen O’Donnell
HDFS-13223 | Reduce DiffListBySkipList memory usage | Major | snapshots | Tsz Wo Nicholas Sze | Shashikant Banerjee
HDFS-13227 | Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList | Minor | snapshots | Shashikant Banerjee | Shashikant Banerjee
HDFS-13222 | Update getBlocks method to take minBlockSize in RPC calls | Major | balancer & mover | Bharat Viswanadham | Bharat Viswanadham
HDFS-13225 | StripeReader#checkMissingBlocks() ’s IOException info is incomplete | Major | erasure-coding, hdfs-client | lufei | lufei
HDFS-11394 | Support for getting erasure coding policy through WebHDFS#FileStatus | Major | erasure-coding, namenode | Kai Sasaki | Kai Sasaki
HDFS-13252 | Code refactoring: Remove Diff.ListType | Major | snapshots | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-12780 | Fix spelling mistake in DistCpUtils.java | Trivial | . | Jianfei Jiang | Jianfei Jiang
HADOOP-15311 | HttpServer2 needs a way to configure the acceptor/selector count | Major | common | Erik Krogen | Erik Krogen
HDFS-13235 | DiskBalancer: Update Documentation to add newly added options | Major | diskbalancer, documentation | Bharat Viswanadham | Bharat Viswanadham
HDFS-336 | dfsadmin -report should report number of blocks from datanode | Minor | . | Lohit Vijayarenu | Bharat Viswanadham
HDFS-11600 | Refactor TestDFSStripedOutputStreamWithFailure test classes | Minor | erasure-coding, test | Andrew Wang | Sammi Chen
HDFS-13257 | Code cleanup: INode never throws QuotaExceededException | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-13275 | Adding log for BlockPoolManager#refreshNamenodes failures | Minor | datanode | Xiaoyu Yao | Ajay Kumar
HDFS-13246 | FileInputStream redundant closes in readReplicasFromCache | Minor | datanode | liaoyuxiangqin | liaoyuxiangqin
HADOOP-15209 | DistCp to eliminate needless deletion of files under already-deleted directories | Major | tools/distcp | Steve Loughran | Steve Loughran
MAPREDUCE-7047 | Make HAR tool support IndexedLogAggregtionController | Major | . | Xuan Gong | Xuan Gong
HDFS-12884 | BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo | Major | namenode | Konstantin Shvachko | chencan
YARN-7064 | Use cgroup to get container resource utilization | Major | nodemanager | Miklos Szegedi | Miklos Szegedi
HADOOP-15334 | Upgrade Maven surefire plugin | Major | build | Arpit Agarwal | Arpit Agarwal
HADOOP-14825 | Über-JIRA: S3Guard Phase II: Hadoop 3.1 features | Major | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-15312 | Undocumented KeyProvider configuration keys | Major | . | Wei-Chiu Chuang | LiXin Ge
YARN-7623 | Fix the CapacityScheduler Queue configuration documentation | Major | . | Arun Suresh | Jonathan Hung
HDFS-13314 | NameNode should optionally exit if it detects FsImage corruption | Major | namenode | Arpit Agarwal | Arpit Agarwal
YARN-8076 | Support to specify application tags in distributed shell | Major | distributed-shell | Weiwei Yang | Weiwei Yang
HADOOP-14831 | Über-jira: S3a phase IV: Hadoop 3.1 features | Blocker | fs/s3 | Steve Loughran | Steve Loughran
YARN-5881 | [Umbrella] Enable configuration of queue capacity in terms of absolute resources | Major | . | Sean Po | Sunil Govindan
HADOOP-14841 | Kms client should disconnect if unable to get output stream from connection. | Major | kms | Xiao Chen | Rushabh S Shah
HDFS-13493 | Reduce the HttpServer2 thread count on DataNodes | Major | datanode | Erik Krogen | Erik Krogen

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
YARN-7023 | Incorrect ReservationId.compareTo() implementation | Minor | reservation system | Oleg Danilov | Oleg Danilov
YARN-7152 | [ATSv2] Registering timeline client before AMRMClient service init throw exception. | Major | timelineclient | Rohith Sharma K S | Rohith Sharma K S
YARN-6992 | Kill application button is visible even if the application is FINISHED in RM UI | Major | . | Sumana Sathish | Suma Shivaprasad
YARN-7140 | CollectorInfo should have Public visibility | Minor | . | Varun Saxena | Varun Saxena
YARN-7130 | ATSv2 documentation changes post merge | Major | timelineserver | Varun Saxena | Varun Saxena
HDFS-12406 | dfsadmin command prints “Exception encountered” even if there is no exception, when debug is enabled | Minor | hdfs-client | Nanda kumar | Nanda kumar
YARN-4727 | Unable to override the $HADOOP_CONF_DIR env variable for container | Major | nodemanager | Terence Yim | Jason Lowe
YARN-7163 | RMContext need not to be injected to webapp and other Always Running services. | Blocker | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HDFS-12424 | Datatable sorting on the Datanode Information page in the Namenode UI is broken | Major | . | Shawna Martell | Shawna Martell
HDFS-12323 | NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout | Major | namenode, qjm | Erik Krogen | Erik Krogen
YARN-7149 | Cross-queue preemption sometimes starves an underserved queue | Major | capacity scheduler | Eric Payne | Eric Payne
YARN-7172 | ResourceCalculator.fitsIn() should not take a cluster resource parameter | Major | scheduler | Daniel Templeton | Sen Zhao
YARN-7199 | Fix TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests | Blocker | . | Botong Huang | Botong Huang
MAPREDUCE-6960 | Shuffle Handler prints disk error stack traces for every read failure. | Major | . | Kuhu Shukla | Kuhu Shukla
HDFS-12480 | TestNameNodeMetrics#testTransactionAndCheckpointMetrics Fails in trunk | Blocker | test | Brahma Reddy Battula | Hanisha Koneru
HDFS-11799 | Introduce a config to allow setting up write pipeline with fewer nodes than replication factor | Major | . | Yongjun Zhang | Brahma Reddy Battula
YARN-7196 | Fix finicky TestContainerManager tests | Major | . | Arun Suresh | Arun Suresh
YARN-6771 | Use classloader inside configuration class to make new classes | Major | . | Jongyoul Lee | Jongyoul Lee
HDFS-12526 | FSDirectory should use Time.monotonicNow for durations | Minor | . | Chetna Chaudhari | Bharat Viswanadham
HDFS-12371 | “BlockVerificationFailures” and “BlocksVerified” show up as 0 in Datanode JMX | Major | metrics | Sai Nukavarapu | Hanisha Koneru
YARN-7034 | DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor | Blocker | nodemanager | Miklos Szegedi | Miklos Szegedi
HDFS-12507 | StripedBlockUtil.java:694: warning - Tag @link: reference not found: StripingCell | Minor | documentation | Tsz Wo Nicholas Sze | Mukul Kumar Singh
MAPREDUCE-6966 | DistSum should use Time.monotonicNow for measuring durations | Minor | . | Chetna Chaudhari | Chetna Chaudhari
YARN-6878 | TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order | Trivial | capacity scheduler, test | Daniel Templeton | Sen Zhao
HDFS-12064 | Reuse object mapper in HDFS | Minor | . | Mingliang Liu | Hanisha Koneru
HDFS-12535 | Change the Scope of the Class DFSUtilClient to Private | Major | . | Bharat Viswanadham | Bharat Viswanadham
HDFS-12536 | Add documentation for getconf command with -journalnodes option | Major | . | Bharat Viswanadham | Bharat Viswanadham
HADOOP-14905 | Fix javadocs issues in Hadoop HDFS-NFS | Major | nfs | Mukul Kumar Singh | Mukul Kumar Singh
HADOOP-14904 | Fix javadocs issues in Hadoop HDFS | Minor | . | Mukul Kumar Singh | Mukul Kumar Singh
HDFS-12339 | NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper | Major | nfs | Sailesh Patel | Mukul Kumar Singh
HDFS-12375 | Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh. | Major | federation, journal-node, scripts | Wenxin He | Bharat Viswanadham
YARN-7153 | Remove duplicated code in AMRMClientAsyncImpl.java | Minor | client | Sen Zhao | Sen Zhao
HADOOP-14897 | Loosen compatibility guidelines for native dependencies | Blocker | documentation, native | Chris Douglas | Daniel Templeton
HDFS-12529 | Get source for config tags from file name | Major | . | Ajay Kumar | Ajay Kumar
YARN-7118 | AHS REST API can return NullPointerException | Major | . | Prabhu Joseph | Billie Rinaldi
HDFS-12495 | TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently | Major | . | Eric Badger | Eric Badger
HADOOP-14822 | hadoop-project/pom.xml is executable | Minor | . | Akira Ajisaka | Ajay Kumar
YARN-7157 | Add admin configuration to filter per-user’s apps in secure cluster | Major | webapp | Sunil Govindan | Sunil Govindan
YARN-7257 | AggregatedLogsBlock reports a bad ‘end’ value as a bad ‘start’ value | Major | log-aggregation | Jason Lowe | Jason Lowe
YARN-7084 | TestSchedulingMonitor#testRMStarts fails sporadically | Major | . | Jason Lowe | Jason Lowe
HDFS-12271 | Incorrect statement in Downgrade section of HDFS Rolling Upgrade document | Minor | documentation | Nanda kumar | Nanda kumar
HDFS-12576 | JournalNodes are getting started, even though dfs.namenode.shared.edits.dir is not configured | Major | journal-node | Bharat Viswanadham | Bharat Viswanadham
HDFS-11968 | ViewFS: StoragePolicies commands fail with HDFS federation | Major | hdfs | Mukul Kumar Singh | Mukul Kumar Singh
YARN-6943 | Update Yarn to YARN in documentation | Minor | documentation | Miklos Szegedi | Chetna Chaudhari
YARN-7211 | AMSimulator in SLS does’t work due to refactor of responseId | Blocker | scheduler-load-simulator | Yufei Gu | Botong Huang
HADOOP-14459 | SerializationFactory shouldn’t throw a NullPointerException if the serializations list is not defined | Minor | . | Nandor Kollar | Nandor Kollar
YARN-7279 | Fix typo in helper message of ContainerLauncher | Trivial | . | Elek, Marton | Elek, Marton
YARN-7258 | Add Node and Rack Hints to Opportunistic Scheduler | Major | . | Arun Suresh | kartheek muthyala
YARN-7285 | ContainerExecutor always launches with priorities due to yarn-default property | Minor | nodemanager | Jason Lowe | Jason Lowe
HDFS-12494 | libhdfs SIGSEGV in setTLSExceptionStrings | Major | libhdfs | John Zhuge | John Zhuge
YARN-7245 | Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user | Major | capacity scheduler, yarn | Eric Payne | Eric Payne
HDFS-11575 | Supporting HDFS NFS gateway with Federated HDFS | Major | nfs | Mukul Kumar Singh | Mukul Kumar Singh
HADOOP-14910 | Upgrade netty-all jar to latest 4.0.x.Final | Critical | . | Vinayakumar B | Vinayakumar B
MAPREDUCE-6951 | Improve exception message when mapreduce.jobhistory.webapp.address is in wrong format | Major | applicationmaster | Prabhu Joseph | Prabhu Joseph
HDFS-12627 | Fix typo in DFSAdmin command output | Trivial | . | Ajay Kumar | Ajay Kumar
HADOOP-13102 | Update GroupsMapping documentation to reflect the new changes | Major | documentation | Anu Engineer | Esther Kundin
YARN-7270 | Fix unsafe casting from long to int for class Resource and its sub-classes | Major | resourcemanager | Yufei Gu | Yufei Gu
YARN-7124 | LogAggregationTFileController deletes/renames while file is open | Critical | nodemanager | Daryn Sharp | Jason Lowe
YARN-7341 | TestRouterWebServiceUtil#testMergeMetrics is flakey | Major | federation | Robert Kanter | Robert Kanter
HADOOP-14958 | CLONE - Fix source-level compatibility after HADOOP-11252 | Blocker | . | Junping Du | Junping Du
YARN-7294 | TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler | Major | . | Miklos Szegedi | Miklos Szegedi
YARN-7355 | TestDistributedShell should be scheduler agnostic | Major | . | Haibo Chen | Haibo Chen
HDFS-12683 | DFSZKFailOverController re-order logic for logging Exception | Major | . | Bharat Viswanadham | Bharat Viswanadham
HADOOP-14966 | Handle JDK-8071638 for hadoop-common | Blocker | . | Bibin A Chundatt | Bibin A Chundatt
HDFS-12695 | Add a link to HDFS router federation document in site.xml | Minor | documentation | Yiqun Lin | Yiqun Lin
YARN-7385 | TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE | Major | test | Robert Kanter | Yufei Gu
HADOOP-14977 | Xenial dockerfile needs ant in main build for findbugs | Trivial | build, test | Allen Wittenauer | Akira Ajisaka
HDFS-12579 | JournalNodeSyncer should use fromUrl field of EditLogManifestResponse to construct servlet Url | Major | . | Hanisha Koneru | Hanisha Koneru
YARN-7375 | Possible NPE in RMWebapp when HA is enabled and the active RM fails | Major | . | Chandni Singh | Chandni Singh
YARN-6747 | TestFSAppStarvation.testPreemptionEnable fails intermittently | Major | . | Sunil Govindan | Miklos Szegedi
YARN-7336 | Unsafe cast from long to int Resource.hashCode() method | Critical | resourcemanager | Daniel Templeton | Miklos Szegedi
HADOOP-14990 | Clean up jdiff xml files added for 2.8.2 release | Blocker | . | Subru Krishnan | Junping Du
HADOOP-14980 | [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1 | Minor | build | ligongyi | ligongyi
HDFS-12714 | Hadoop 3 missing fix for HDFS-5169 | Major | native | Joe McDonnell | Joe McDonnell
YARN-7146 | Many RM unit tests failing with FairScheduler | Major | test | Robert Kanter | Robert Kanter
YARN-7396 | NPE when accessing container logs due to null dirsHandler | Major | . | Jonathan Hung | Jonathan Hung
YARN-7370 | Preemption properties should be refreshable | Major | capacity scheduler, scheduler preemption | Eric Payne | Gergely Novák
YARN-7400 | incorrect log preview displayed in jobhistory server ui | Major | yarn | Santhosh B Gowda | Xuan Gong
HADOOP-15013 | Fix ResourceEstimator findbugs issues | Blocker | . | Allen Wittenauer | Arun Suresh
YARN-7432 | Fix DominantResourceFairnessPolicy serializable findbugs issues | Blocker | . | Allen Wittenauer | Daniel Templeton
YARN-7434 | Router getApps REST invocation fails with multiple RMs | Critical | . | Subru Krishnan | Íñigo Goiri
HADOOP-15015 | TestConfigurationFieldsBase to use SLF4J for logging | Trivial | conf, test | Steve Loughran | Steve Loughran
YARN-7428 | Add containerId to Localizer failed logs | Minor | nodemanager | Prabhu Joseph | Prabhu Joseph
YARN-4793 | [Umbrella] Simplified API layer for services and beyond | Major | . | Vinod Kumar Vavilapalli |
HADOOP-15018 | Update JAVA_HOME in create-release for Xenial Dockerfile | Blocker | build | Andrew Wang | Andrew Wang
HDFS-12788 | Reset the upload button when file upload fails | Critical | ui, webhdfs | Brahma Reddy Battula | Brahma Reddy Battula
YARN-7453 | Fix issue where RM fails to switch to active after first successful start | Blocker | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
YARN-7458 | TestContainerManagerSecurity is still flakey | Major | test | Robert Kanter | Robert Kanter
YARN-7454 | RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup | Minor | resourcemanager | Jason Lowe | Jason Lowe
YARN-7465 | start-yarn.sh fails to start ResourceManager unless running as root | Blocker | . | Sean Mackrory |
HDFS-12791 | NameNode Fsck http Connection can timeout for directories with multiple levels | Major | tools | Mukul Kumar Singh | Mukul Kumar Singh
HDFS-12797 | Add Test for NFS mount of not supported filesystems like (file:///) | Minor | nfs | Mukul Kumar Singh | Mukul Kumar Singh
HADOOP-14929 | Cleanup usage of decodecomponent and use QueryStringDecoder from netty | Major | . | Bharat Viswanadham | Bharat Viswanadham
HDFS-12498 | Journal Syncer is not started in Federated + HA cluster | Major | federation, journal-node | Bharat Viswanadham | Bharat Viswanadham
YARN-7452 | Decommissioning node default value to be zero in new YARN UI | Trivial | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
YARN-7445 | Render Applications and Services page with filters in new YARN UI | Major | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
HADOOP-15031 | Fix javadoc issues in Hadoop Common | Minor | common | Mukul Kumar Singh | Mukul Kumar Singh
HDFS-12705 | WebHdfsFileSystem exceptions should retain the caused by exception | Major | hdfs | Daryn Sharp | Hanisha Koneru
YARN-7462 | Render outstanding resource requests on application page of new YARN UI | Major | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
YARN-7464 | Introduce filters in Nodes page of new YARN UI | Major | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
YARN-7361 | Improve the docker container runtime documentation | Major | . | Shane Kumpf | Shane Kumpf
YARN-7492 | Set up SASS for new YARN UI styling | Major | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
YARN-7469 | Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit | Major | capacity scheduler, yarn | Eric Payne | Eric Payne
HADOOP-14982 | Clients using FailoverOnNetworkExceptionRetry can go into a loop if they’re used without authenticating with kerberos in HA env | Major | common | Peter Bacsko | Peter Bacsko
YARN-7489 | ConcurrentModificationException in RMAppImpl#getRMAppMetrics | Major | capacityscheduler | Tao Yang | Tao Yang
YARN-7525 | Incorrect query parameters in cluster nodes REST API document | Minor | documentation | Tao Yang | Tao Yang
HDFS-12813 | RequestHedgingProxyProvider can hide Exception thrown from the Namenode for proxy size of 1 | Major | ha | Mukul Kumar Singh | Mukul Kumar Singh
HADOOP-15046 | Document Apache Hadoop does not support Java 9 in BUILDING.txt | Major | documentation | Akira Ajisaka | Hanisha Koneru
YARN-7513 | Remove scheduler lock in FSAppAttempt.getWeight() | Minor | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg
YARN-7390 | All reservation related test cases failed when TestYarnClient runs against Fair Scheduler. | Major | fairscheduler, reservation system | Yufei Gu | Yufei Gu
YARN-7290 | Method canContainerBePreempted can return true when it shouldn’t | Major | fairscheduler | Steven Rand | Steven Rand
MAPREDUCE-7014 | Fix java doc errors in jdk1.8 | Major | . | Rohith Sharma K S | Steve Loughran
YARN-7363 | ContainerLocalizer doesn’t have a valid log4j config when using LinuxContainerExecutor | Major | nodemanager | Yufei Gu | Yufei Gu
HDFS-12754 | Lease renewal can hit a deadlock | Major | . | Kuhu Shukla | Kuhu Shukla
YARN-7499 | Layout changes to Application details page in new YARN UI | Major | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
HDFS-12857 | StoragePolicyAdmin should support schema based path | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore
HDFS-12832 | INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit | Critical | namenode | DENG FEI | Konstantin Shvachko
HADOOP-15054 | upgrade hadoop dependency on commons-codec to 1.11 | Major | . | PJ Fanning | Bharat Viswanadham
HDFS-11754 | Make FsServerDefaults cache configurable. | Minor | . | Rushabh S Shah | Mikhail Erofeev
HADOOP-15042 | Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0 | Minor | fs/azure | Rajesh Balamohan | Rajesh Balamohan
YARN-7509 | AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby | Critical | . | Tao Yang | Tao Yang
HDFS-12681 | Make HdfsLocatedFileStatus a subtype of LocatedFileStatus | Major | . | Chris Douglas | Chris Douglas
YARN-7558 | “yarn logs” command fails to get logs for running containers if UI authentication is enabled. | Critical | . | Namit Maheshwari | Xuan Gong
HDFS-12638 | Delete copy-on-truncate block along with the original block, when deleting a file being truncated | Blocker | hdfs | Jiandan Yang | Konstantin Shvachko
YARN-7546 | Layout changes in Queue UI to show queue details on right pane | Major | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
HDFS-12836 | startTxId could be greater than endTxId when tailing in-progress edit log | Major | hdfs | Chao Sun | Chao Sun
YARN-4813 | TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently | Major | resourcemanager | Daniel Templeton | Gergo Repas
MAPREDUCE-5124 | AM lacks flow control for task events | Major | mr-am | Jason Lowe | Peter Bacsko
YARN-7589 | TestPBImplRecords fails with NullPointerException | Major | . | Jason Lowe | Daniel Templeton
YARN-7455 | quote_and_append_arg can overflow buffer | Major | nodemanager | Jason Lowe | Jim Brennan
HADOOP-14600 | LocatedFileStatus constructor forces RawLocalFS to exec a process to get the permissions | Major | fs | Steve Loughran | Ping Liu
YARN-7594 | TestNMWebServices#testGetNMResourceInfo fails on trunk | Major | nodemanager, webapp | Gergely Novák | Gergely Novák
YARN-5594 | Handle old RMDelegationToken format when recovering RM | Major | resourcemanager | Tatyana But | Robert Kanter
HADOOP-15058 | create-release site build outputs dummy shaded jars due to skipShade | Blocker | . | Andrew Wang | Andrew Wang
HADOOP-14985 | Remove subversion related code from VersionInfoMojo.java | Minor | build | Akira Ajisaka | Ajay Kumar
YARN-7586 | Application Placement should be done before ACL checks in ResourceManager | Blocker | . | Suma Shivaprasad | Suma Shivaprasad
HDFS-11751 | DFSZKFailoverController daemon exits with wrong status code | Major | auto-failover | Doris Gu | Bharat Viswanadham
HADOOP-15080 | Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x “json-lib” | Blocker | fs/oss | Chris Douglas | Sammi Chen
HADOOP-15098 | TestClusterTopology#testChooseRandom fails intermittently | Major | test | Zsolt Venczel | Zsolt Venczel
YARN-7608 | Incorrect sTarget column causing DataTable warning on RM application and scheduler web page | Major | resourcemanager, webapp | Weiwei Yang | Gergely Novák
HDFS-12891 | Do not invalidate blocks if toInvalidate is empty | Major | . | Zsolt Venczel | Zsolt Venczel
YARN-7635 | TestRMWebServicesSchedulerActivities fails in trunk | Major | test | Sunil Govindan | Sunil Govindan
HDFS-12833 | Distcp : Update the usage of delete option for dependency with update and overwrite option | Minor | distcp, hdfs | Harshakiran Reddy | usharani
YARN-7647 | NM print inappropriate error log when node-labels is enabled | Minor | . | Yang Wang | Yang Wang
YARN-7536 | em-table improvement for better filtering in new YARN UI | Minor | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
HDFS-12907 | Allow read-only access to reserved raw for non-superusers | Major | namenode | Daryn Sharp | Rushabh S Shah
HDFS-12881 | Output streams closed with IOUtils suppressing write errors | Major | . | Jason Lowe | Ajay Kumar
YARN-7595 | Container launching code suppresses close exceptions after writes | Major | nodemanager | Jason Lowe | Jim Brennan
HADOOP-15085 | Output streams closed with IOUtils suppressing write errors | Major | . | Jason Lowe | Jim Brennan
YARN-7629 | TestContainerLaunch# fails after YARN-7381 | Major | . | Jason Lowe | Jason Lowe
YARN-7664 | Several javadoc errors | Blocker | . | Sean Mackrory | Sean Mackrory
HADOOP-15123 | KDiag tries to load krb5.conf from KRB5CCNAME instead of KRB5_CONFIG | Minor | security | Vipin Rathor | Vipin Rathor
HADOOP-15109 | TestDFSIO -read -random doesn’t work on file sized 4GB | Minor | fs, test | zhoutai.zt | Ajay Kumar
YARN-7661 | NodeManager metrics return wrong value after update node resource | Major | . | Yang Wang | Yang Wang
HDFS-12930 | Remove the extra space in HdfsImageViewer.md | Trivial | documentation | Yiqun Lin | Rahul Pathak
YARN-7662 | [Atsv2] Define new set of configurations for reader and collectors to bind. | Major | . | Rohith Sharma K S | Rohith Sharma K S
YARN-7466 | ResourceRequest has a different default for allocationRequestId than Container | Major | . | Chandni Singh | Chandni Singh
YARN-7674 | Update Timeline Reader web app address in UI2 | Major | . | Rohith Sharma K S | Sunil Govindan
YARN-7577 | Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart | Major | . | Miklos Szegedi | Miklos Szegedi
HDFS-12949 | Fix findbugs warning in ImageWriter.java | Major | . | Akira Ajisaka | Akira Ajisaka
HDFS-12938 | TestErasureCodigCLI testAll failing consistently. | Major | erasure-coding, hdfs | Rushabh S Shah | Ajay Kumar
HDFS-12951 | Incorrect javadoc in SaslDataTransferServer.java#receive | Major | encryption | Mukul Kumar Singh | Mukul Kumar Singh
HDFS-12959 | Fix TestOpenFilesWithSnapshot redundant configurations | Minor | hdfs | Manoj Govindassamy | Manoj Govindassamy
YARN-7542 | Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED | Major | . | Arun Suresh | Sampada Dehankar
HDFS-12915 | Fix findbugs warning in INodeFile$HeaderFormat.getBlockLayoutRedundancy | Major | namenode | Wei-Chiu Chuang | Chris Douglas
YARN-7555 | Support multiple resource types in YARN native services | Critical | yarn-native-services | Wangda Tan | Wangda Tan
HADOOP-15122 | Lock down version of doxia-module-markdown plugin | Blocker | . | Elek, Marton | Elek, Marton
HADOOP-15143 | NPE due to Invalid KerberosTicket in UGI | Major | . | Jitendra Nath Pandey | Mukul Kumar Singh
HADOOP-15152 | Typo in javadoc of ReconfigurableBase#reconfigurePropertyImpl | Trivial | common | Nanda kumar | Nanda kumar
HADOOP-15155 | Error in javadoc of ReconfigurableBase#reconfigureProperty | Minor | . | Ajay Kumar | Ajay Kumar
YARN-7585 | NodeManager should go unhealthy when state store throws DBException | Major | nodemanager | Wilfred Spiegelenburg | Wilfred Spiegelenburg
YARN-6894 | RM Apps API returns only active apps when query parameter queue used | Minor | resourcemanager, restapi | Grant Sohn | Gergely Novák
YARN-7692 | Skip validating priority acls while recovering applications | Blocker | resourcemanager | Charan Hebri | Sunil Govindan
MAPREDUCE-7028 | Concurrent task progress updates causing NPE in Application Master | Blocker | mr-am | Gergo Repas | Gergo Repas
YARN-7602 | NM should reference the singleton JvmMetrics instance | Major | nodemanager | Haibo Chen | Haibo Chen
HADOOP-15093 | Deprecation of yarn.resourcemanager.zk-address is undocumented | Major | documentation | Namit Maheshwari | Ajay Kumar
HDFS-12931 | Handle InvalidEncryptionKeyException during DistributedFileSystem#getFileChecksum | Major | encryption | Mukul Kumar Singh | Mukul Kumar Singh
HDFS-12948 | DiskBalancer report command top option should only take positive numeric values | Minor | diskbalancer | Namit Maheshwari | Shashikant Banerjee
HDFS-12913 | TestDNFencingWithReplication.testFencingStress fix mini cluster not yet active issue | Major | . | Zsolt Venczel | Zsolt Venczel
HDFS-12987 | Document - Disabling the Lazy persist file scrubber. | Trivial | documentation, hdfs | Karthik Palanisamy | Karthik Palanisamy
HDFS-12860 | StripedBlockUtil#getRangesInternalBlocks throws exception for the block group size larger than 2GB | Major | erasure-coding | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-7619 | Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user | Major | capacity scheduler, yarn | Eric Payne | Eric Payne
YARN-7645 | TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers is flakey with FairScheduler | Major | test | Robert Kanter | Robert Kanter
YARN-7699 | queueUsagePercentage is coming as INF for getApp REST api call | Major | webapp | Sunil Govindan | Sunil Govindan
HDFS-12985 | NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted | Major | hdfs | Manoj Govindassamy | Manoj Govindassamy
YARN-4227 | Ignore expired containers from removed nodes in FairScheduler | Critical | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg
YARN-7718 | DistributedShell failed to specify resource other than memory/vcores from container_resources | Critical | . | Wangda Tan | Wangda Tan
YARN-7508 | NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode | Major | capacityscheduler | Tao Yang | Tao Yang
YARN-7663 | RMAppImpl:Invalid event: START at KILLED | Major | resourcemanager | lujie | lujie
YARN-6948 | Invalid event: ATTEMPT_ADDED at FINAL_SAVING | Major | yarn | lujie | lujie
HDFS-12994 | TestReconstructStripedFile.testNNSendsErasureCodingTasks fails due to socket timeout | Major | erasure-coding | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-7665 | Allow FS scheduler state dump to be turned on/off separately from FS debug log | Major | . | Wilfred Spiegelenburg | Wilfred Spiegelenburg
YARN-7689 | TestRMContainerAllocator fails after YARN-6124 | Major | scheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg
HADOOP-15163 | Fix S3ACommitter documentation | Minor | documentation, fs/s3 | Alessandro Andrioni | Alessandro Andrioni
HADOOP-15060 | TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky | Major | . | Miklos Szegedi | Miklos Szegedi
YARN-7735 | Fix typo in YARN documentation | Minor | documentation | Takanobu Asanuma | Takanobu Asanuma
YARN-7727 | Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector | Minor | yarn | Prabhu Joseph | Prabhu Joseph
HDFS-12984 | BlockPoolSlice can leak in a mini dfs cluster | Major | . | Robert Joseph Evans | Ajay Kumar
HDFS-11915 | Sync rbw dir on the first hsync() to avoid file lost on power failure | Critical | . | Kanaka Kumar Avvaru | Vinayakumar B
YARN-7731 | RegistryDNS should handle upstream DNS returning CNAME | Major | . | Billie Rinaldi | Eric Yang
YARN-7671 | Improve Diagonstic message for stop yarn native service | Major | . | Yesha Vora | Chandni Singh
YARN-7705 | Create the container log directory with correct sticky bit in C code | Major | nodemanager | Yufei Gu | Yufei Gu
HDFS-13016 | globStatus javadoc refers to glob pattern as “regular expression” | Trivial | documentation, hdfs | Ryanne Dolan | Mukul Kumar Singh
HADOOP-15172 | Fix the javadoc warning in WriteOperationHelper.java | Minor | documentation, fs/s3 | Mukul Kumar Singh | Mukul Kumar Singh
YARN-7479 | TestContainerManagerSecurity.testContainerManager[Simple] flaky in trunk | Major | test | Botong Huang | Akira Ajisaka
HDFS-13004 | TestLeaseRecoveryStriped#testLeaseRecovery is failing when safeLength is 0MB or larger than the test file | Major | hdfs | Zsolt Venczel | Zsolt Venczel
HDFS-9049 | Make Datanode Netty reverse proxy port to be configurable | Major | datanode | Vinayakumar B | Vinayakumar B
YARN-7758 | Add an additional check to the validity of container and application ids passed to container-executor | Major | nodemanager | Miklos Szegedi | Yufei Gu
YARN-7717 | Add configuration consistency for module.enabled and docker.privileged-containers.enabled | Major | . | Yesha Vora | Eric Badger
HADOOP-15150 | in FsShell, UGI params should be overidden through env vars(-D arg) | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
YARN-7750 | [UI2] Render time related fields in all pages to the browser timezone | Major | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
YARN-7740 | Fix logging for destroy yarn service cli when app does not exist and some minor bugs | Major | yarn-native-services | Yesha Vora | Jian He
YARN-7139 | FairScheduler: finished applications are always restored to default queue | Major | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg
YARN-7753 | [UI2] Meta information about Application logs has to be pulled from ATS 1.5 instead of ATS2 | Major | yarn-ui-v2 | Sunil Govindan | Sunil Govindan
HADOOP-14788 | Credentials readTokenStorageFile to stop wrapping IOEs in IOEs | Minor | security | Steve Loughran | Ajay Kumar
HDFS-13039 | StripedBlockReader#createBlockReader leaks socket on IOException | Critical | datanode, erasure-coding | Lei (Eddy) Xu | Lei (Eddy) Xu
HADOOP-15181 | Typo in SecureMode.md | Trivial | documentation | Masahiro Tanaka | Masahiro Tanaka
YARN-7738 | CapacityScheduler: Support refresh maximum allocation for multiple resource types | Blocker | . | Sumana Sathish | Wangda Tan
YARN-7766 | Introduce a new config property for YARN Service dependency tarball location | Major | applications, client, yarn-native-services | Gour Saha | Gour Saha
HDFS-12963 | Error log level in ShortCircuitRegistry#removeShm | Minor | . | hu xiaodong | hu xiaodong
YARN-7796 | Container-executor fails with segfault on certain OS configurations | Major | nodemanager | Gergo Repas | Gergo Repas
YARN-7749 | [UI2] GPU information tab in left hand side disappears when we click other tabs below | Major | . | Sumana Sathish | Vasudevan Skm
YARN-7806 | Distributed Shell should use timeline async api’s | Major | distributed-shell | Sumana Sathish | Rohith Sharma K S
HDFS-13023 | Journal Sync does not work on a secure cluster | Major | journal-node | Namit Maheshwari | Bharat Viswanadham
HADOOP-15121 | Encounter NullPointerException when using DecayRpcScheduler | Major | . | Tao Jie | Tao Jie
MAPREDUCE-7015 | Possible race condition in JHS if the job is not loaded | Major | jobhistoryserver | Peter Bacsko | Peter Bacsko
YARN-7737 | prelaunch.err file not found exception on container failure | Major | . | Jonathan Hung | Keqiu Hu
YARN-7777 | Fix user name format in YARN Registry DNS name | Major | . | Jian He | Jian He
YARN-7628 | [Documentation] Documenting the ability to disable elasticity at leaf queue | Major | capacity scheduler | Zian Chen | Zian Chen
HDFS-13063 | Fix the incorrect spelling in HDFSHighAvailabilityWithQJM.md | Trivial | documentation | Jianfei Jiang | Jianfei Jiang
YARN-7102 | NM heartbeat stuck when responseId overflows MAX_INT | Critical | . | Botong Huang | Botong Huang
MAPREDUCE-7041 | MR should not try to clean up at first job attempt | Major | . | Takanobu Asanuma | Gergo Repas
YARN-7742 | [UI2] Duplicated containers are rendered per attempt | Major | . | Rohith Sharma K S | Vasudevan Skm
YARN-7760 | [UI2] Clicking ‘Master Node’ or link next to ‘AM Node Web UI’ under application’s appAttempt page goes to OLD RM UI | Major | . | Sumana Sathish | Vasudevan Skm
MAPREDUCE-7020 | Task timeout in uber mode can crash AM | Major | mr-am | Akira Ajisaka | Peter Bacsko
YARN-7765 | [Atsv2] GSSException: No valid credentials provided - Failed to find any Kerberos tgt thrown by Timelinev2Client & HBaseClient in NM | Blocker | . | Sumana Sathish | Rohith Sharma K S
HDFS-13065 | TestErasureCodingMultipleRacks#testSkewedRack3 is failing | Major | hdfs | Gabor Bota | Gabor Bota
HDFS-12974 | Exception message is not printed when creating an encryption zone fails with AuthorizationException | Minor | encryption | fang zhenyi | fang zhenyi
YARN-7698 | A misleading variable’s name in ApplicationAttemptEventDispatcher | Minor | resourcemanager | Jinjiang Ling | Jinjiang Ling
YARN-7790 | Improve Capacity Scheduler Async Scheduling to better handle node failures | Critical | . | Sumana Sathish | Wangda Tan
HDFS-12528 | Add an option to not disable short-circuit reads on failures | Major | hdfs-client, performance | Andre Araujo | Xiao Chen
YARN-7861 | [UI2] Logs page shows duplicated containers with ATS | Major | yarn-ui-v2 | Sunil Govindan | Sunil Govindan
YARN-7828 | Clicking on yarn service should take to component tab | Major | yarn-ui-v2 | Yesha Vora | Sunil Govindan
HDFS-13061 | SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel | Major | . | Xiaoyu Yao | Ajay Kumar
HDFS-13060 | Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver | Major | datanode, security | Xiaoyu Yao | Ajay Kumar
HDFS-12897 | getErasureCodingPolicy should handle .snapshot dir better | Major | erasure-coding, hdfs, snapshots | Harshakiran Reddy | LiXin Ge
MAPREDUCE-7033 | Map outputs implicitly rely on permissive umask for shuffle | Critical | mrv2 | Jason Lowe | Jason Lowe
HDFS-13048 | LowRedundancyReplicatedBlocks metric can be negative | Major | metrics | Akira Ajisaka | Akira Ajisaka
HADOOP-15198 | Correct the spelling in CopyFilter.java | Major | tools/distcp | Mukul Kumar Singh | Mukul Kumar Singh
YARN-7831 | YARN Service CLI should use hadoop.http.authentication.type to determine authentication method | Major | . | Eric Yang | Eric Yang
YARN-7879 | NM user is unable to access the application filecache due to permissions | Critical | . | Shane Kumpf | Jason Lowe
HDFS-13100 | Handle IllegalArgumentException when GETSERVERDEFAULTS is not implemented in webhdfs. | Critical | hdfs, webhdfs | Yongjun Zhang | Yongjun Zhang
YARN-7876 | Localized jars that are expanded after localization are not fully copied | Blocker | . | Miklos Szegedi | Miklos Szegedi
YARN-7849 | TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error | Major | test | Jason Lowe | Botong Huang
YARN-7801 | AmFilterInitializer should addFilter after fill all parameters | Critical | . | Sumana Sathish | Wangda Tan
YARN-7889 | Missing kerberos token when check for RM REST API availability | Major | yarn-native-services | Eric Yang | Eric Yang
YARN-7850 | [UI2] Log Aggregation status to be displayed in Application Page | Major | yarn-ui-v2 | Yesha Vora | Gergely Novák
YARN-7866 | [UI2] Error to be displayed correctly while accessing kerberized cluster without kinit | Major | yarn-ui-v2 | Sumana Sathish | Sunil Govindan
YARN-7890 | NPE during container relaunch | Major | . | Billie Rinaldi | Jason Lowe
HDFS-11701 | NPE from Unresolved Host causes permanent DFSInputStream failures | Major | hdfs-client | James Moore | Lokesh Jain
HDFS-13115 | In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted | Major | . | Yongjun Zhang | Yongjun Zhang
HDFS-12935 | Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up | Major | tools | Jianfei Jiang | Jianfei Jiang
YARN-7827 | Stop and Delete Yarn Service from RM UI fails with HTTP ERROR 404 | Critical | yarn-ui-v2 | Yesha Vora | Sunil Govindan
HDFS-13120 | Snapshot diff could be corrupted after concat | Major | namenode, snapshots | Xiaoyu Yao | Xiaoyu Yao
YARN-7909 | YARN service REST API returns charset=null when kerberos enabled | Major | yarn-native-services | Eric Yang | Eric Yang
HDFS-13130 | Log object instance get incorrectly in SlowDiskTracker | Minor | . | Jianfei Jiang | Jianfei Jiang
YARN-7906 | Fix mvn site fails with error: Multiple sources of package comments found for package “o.a.h.y.client.api.impl” | Blocker | build, documentation | Akira Ajisaka | Akira Ajisaka
YARN-5848 | Remove unnecessary public/crossdomain.xml from YARN UIv2 sub project | Blocker | yarn-ui-v2 | Allen Wittenauer | Sunil Govindan
YARN-7697 | NM goes down with OOM due to leak in log-aggregation | Blocker | . | Santhosh B Gowda | Xuan Gong
YARN-7739 | DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation | Blocker | . | Wangda Tan | Wangda Tan
HDFS-10453 | ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster. | Major | namenode | He Xiaoqiao | He Xiaoqiao
HDFS-8693 | refreshNamenodes does not support adding a new standby to a running DN | Critical | datanode, ha | Jian Fang | Ajith S
MAPREDUCE-7052 | TestFixedLengthInputFormat#testFormatCompressedIn is flaky | Major | client, test | Peter Bacsko | Peter Bacsko
HDFS-13112 | Token expiration edits may cause log corruption or deadlock | Critical | namenode | Daryn Sharp | Daryn Sharp
HDFS-13151 | Fix the javadoc error in ReplicaInfo | Minor | . | Bharat Viswanadham | Bharat Viswanadham
MAPREDUCE-7053 | Timed out tasks can fail to produce thread dump | Major | . | Jason Lowe | Jason Lowe
HDFS-13058 | Fix dfs.namenode.shared.edits.dir in TestJournalNode | Major | journal-node, test | Bharat Viswanadham | Bharat Viswanadham
HADOOP-15206 | BZip2 drops and duplicates records when input split size is small | Major | . | Aki Tanaka | Aki Tanaka
YARN-7937 | Fix http method name in Cluster Application Timeout Update API example request | Minor | docs, documentation | Charan Hebri | Charan Hebri
HADOOP-15223 | Replace Collections.EMPTY* with empty* when available | Minor | . | Akira Ajisaka | fang zhenyi
HDFS-13159 | TestTruncateQuotaUpdate fails in trunk | Major | test | Arpit Agarwal | Nanda kumar
YARN-7947 | Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps | Major | capacity scheduler, scheduler preemption | Eric Payne | Eric Payne
HADOOP-10571 | Use Log.*(Object, Throwable) overload to log exceptions | Major | . | Arpit Agarwal | Andras Bokor
HADOOP-6852 | apparent bug in concatenated-bzip2 support (decoding) | Major | io | Greg Roelofs | Zsolt Venczel
YARN-7942 | Yarn ServiceClient does not not delete znode from secure ZooKeeper | Blocker | yarn-native-services | Eric Yang | Billie Rinaldi
HADOOP-15236 | Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider | Trivial | documentation | Akira Ajisaka | Gabor Bota
YARN-7675 | [UI2] Support loading pre-2.8 version /scheduler REST response for queue page | Major | yarn-ui-v2 | Gergely Novák | Gergely Novák
YARN-7949 | [UI2] ArtifactsId should not be a compulsory field for new service | Major | yarn-ui-v2 | Yesha Vora | Yesha Vora
YARN-5714 | ContainerExecutor does not order environment map | Trivial | nodemanager | Remi Catherinot | Remi Catherinot
MAPREDUCE-7027 | HadoopArchiveLogs shouldn’t delete the original logs if the HAR creation fails | Critical | mrv2 | Gergely Novák | Gergely Novák
HDFS-12865 | RequestHedgingProxyProvider should handle case when none of the proxies are available | Major | ha | Mukul Kumar Singh | Mukul Kumar Singh
HADOOP-15254 | Correct the wrong word spelling ‘intialize’ | Minor | . | fang zhenyi | fang zhenyi
HDFS-12781 | After Datanode down, In Namenode UI Datanode tab is throwing warning message. | Major | datanode | Harshakiran Reddy | Brahma Reddy Battula
HDFS-12070 | Failed block recovery leaves files open indefinitely and at risk for data loss | Major | . | Daryn Sharp | Kihwal Lee
HADOOP-15265 | Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively | Major | . | Nishant Bangarwa | Nishant Bangarwa
YARN-7963 | TestServiceAM and TestServiceMonitor test cases are hanging | Major | yarn-native-services | Eric Yang | Chandni Singh
HDFS-13145 | SBN crash when transition to ANN with in-progress edit tailing enabled | Major | ha, namenode | Chao Sun | Chao Sun
HDFS-13181 | DiskBalancer: Add an configuration for valid plan hours | Major | diskbalancer | Bharat Viswanadham | Bharat Viswanadham
HDFS-13143 | SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree | Major | snapshots | Shashikant Banerjee | Shashikant Banerjee
HDFS-13194 | CachePool permissions incorrectly checked | Major | . | Yiqun Lin | Jianfei Jiang
HDFS-13114 | CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path | Major | encryption, hdfs | Hanisha Koneru | Hanisha Koneru
HDFS-13081 | Datanode#checkSecureConfig should allow SASL and privileged HTTP | Major | datanode, security | Xiaoyu Yao | Ajay Kumar
YARN-7985 | Service name is validated twice in ServiceClient when a service is created | Trivial | yarn-native-services | Chandni Singh | Chandni Singh
MAPREDUCE-7059 | Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster | Critical | job submission | Jiandan Yang | Jiandan Yang
YARN-7835 | [Atsv2] Race condition in NM while publishing events if second attempt is launched on the same node | Critical | . | Rohith Sharma K S | Rohith Sharma K S
HADOOP-15275 | Incorrect javadoc for return type of RetryPolicy#shouldRetry | Minor | documentation | Nanda kumar | Nanda kumar
YARN-7958 | ServiceMaster should only wait for recovery of containers with id that match the current application id | Critical | yarn | Chandni Singh | Chandni Singh
HDFS-13211 | Fix a bug in DirectoryDiffList.getMinListForRange | Major | snapshots | Shashikant Banerjee | Shashikant Banerjee
HDFS-13210 | Fix the typo in MiniDFSCluster class | Trivial | test | Yiqun Lin | fang zhenyi
YARN-7511 | NPE in ContainerLocalizer when localization failed for running container | Major | nodemanager | Tao Yang | Tao Yang
HADOOP-15261 | Upgrade commons-io from 2.4 to 2.5 | Major | minikdc | PandaMonkey | PandaMonkey
MAPREDUCE-7023 | TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun | Minor | test | Gergely Novák | Gergely Novák
HDFS-13178 | Disk Balancer: Add skipDateCheck option to DiskBalancer Execute command | Major | diskbalancer | Bharat Viswanadham | Bharat Viswanadham
HADOOP-15286 | Remove unused imports from TestKMSWithZK.java | Minor | test | Akira Ajisaka | Ajay Kumar
YARN-7995 | Remove unnecessary boxings and unboxings from PlacementConstraintParser.java | Minor | . | Akira Ajisaka | Sen Zhao
HDFS-13040 | Kerberized inotify client fails despite kinit properly | Major | namenode | Wei-Chiu Chuang | Xiao Chen
HADOOP-15288 | TestSwiftFileSystemBlockLocation doesn’t compile | Critical | build, fs/swift | Steve Loughran | Steve Loughran
YARN-7736 | Fix itemization in YARN federation document | Minor | documentation | Akira Ajisaka | Sen Zhao
HDFS-13164 | File not closed if streamer fail with DSQuotaExceededException | Major | hdfs-client | Xiao Chen | Xiao Chen
HADOOP-15289 | FileStatus.readFields() assertion incorrect | Critical | . | Steve Loughran | Steve Loughran
HDFS-13188 | Disk Balancer: Support multiple block pools during block move | Major | diskbalancer | Bharat Viswanadham | Bharat Viswanadham
HDFS-13109 | Support fully qualified hdfs path in EZ commands | Major | hdfs | Hanisha Koneru | Hanisha Koneru
HADOOP-15296 | Fix a wrong link for RBF in the top page | Minor | documentation | Takanobu Asanuma | Takanobu Asanuma
YARN-8011 | TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk | Minor | . | Tao Yang | Tao Yang
HADOOP-15292 | Distcp’s use of pread is slowing it down. | Minor | tools/distcp | Virajith Jalaparti | Virajith Jalaparti
HADOOP-15273 | distcp can’t handle remote stores with different checksum algorithms | Critical | tools/distcp | Steve Loughran | Steve Loughran
HADOOP-15280 | TestKMS.testWebHDFSProxyUserKerb and TestKMS.testWebHDFSProxyUserSimple fail in trunk | Major | . | Ray Chiang | Bharat Viswanadham
YARN-7944 | [UI2] Remove master node link from headers of application pages | Major | yarn-ui-v2 | Yesha Vora | Yesha Vora
MAPREDUCE-6930 | mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml | Major | mrv2 | Daniel Templeton | Sen Zhao
YARN-8000 | Yarn Service: component instance name shows up as component name in container record | Major | . | Chandni Singh | Chandni Singh
HDFS-13190 | Document WebHDFS support for snapshot diff | Major | documentation, webhdfs | Xiaoyu Yao | Lokesh Jain
HDFS-13244 | Add stack, conf, metrics links to utilities dropdown in NN webUI | Major | . | Bharat Viswanadham | Bharat Viswanadham
HDFS-10618 | TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition | Major | . | Eric Badger | Eric Badger
YARN-8024 | LOG in class MaxRunningAppsEnforcer is initialized with a faulty class FairScheduler | Major | fairscheduler | Yufei Gu | Sen Zhao
HDFS-10803 | TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available | Major | . | Yiqun Lin | Yiqun Lin
HDFS-12156 | TestFSImage fails without -Pnative | Major | test | Akira Ajisaka | Akira Ajisaka
HDFS-13271 | WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument | Major | webhdfs | Lokesh Jain | Lokesh Jain
HDFS-13239 | Fix non-empty dir warning message when setting default EC policy | Minor | . | Hanisha Koneru | Bharat Viswanadham
YARN-8022 | ResourceManager UI cluster/app/<app-id> page fails to render | Blocker | webapp | Tarun Parimi | Tarun Parimi
HDFS-13249 | Document webhdfs support for getting snapshottable directory list | Major | documentation, webhdfs | Lokesh Jain | Lokesh Jain
MAPREDUCE-7064 | Flaky test TestTaskAttempt#testReducerCustomResourceTypes | Major | client, test | Peter Bacsko | Peter Bacsko
HDFS-13261 | Fix incorrect null value check | Minor | hdfs | Jianfei Jiang | Jianfei Jiang
HADOOP-15305 | Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings | Minor | . | Akira Ajisaka | fang zhenyi
HDFS-12723 | TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. | Major | . | Rushabh S Shah | Ajay Kumar
HDFS-13251 | Avoid using hard coded datanode data dirs in unit tests | Major | test | Xiaoyu Yao | Ajay Kumar
HDFS-13280 | WebHDFS: Fix NPE in get snasphottable directory list call | Major | webhdfs | Lokesh Jain | Lokesh Jain
YARN-7952 | RM should be able to recover log aggregation status after restart/fail-over | Major | . | Xuan Gong | Xuan Gong
HADOOP-15234 | Throw meaningful message on null when initializing KMSWebApp | Major | kms | Xiao Chen | fang zhenyi
YARN-7636 | Re-reservation count may overflow when cluster resource exhausted for a long time | Major | capacityscheduler | Tao Yang | Tao Yang
HDFS-12886 | Ignore minReplication for block recovery | Major | hdfs, namenode | Lukas Majercak | Lukas Majercak
YARN-8039 | Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer | Minor | . | Miklos Szegedi | Miklos Szegedi
HDFS-13296 | GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases | Major | . | Xiao Liang | Xiao Liang
HDFS-13268 | TestWebHdfsFileContextMainOperations fails on Windows | Major | . | Íñigo Goiri | Xiao Liang
YARN-8054 | Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread | Major | . | Jonathan Eagles | Jonathan Eagles
YARN-7873 | Revert YARN-6078 | Blocker | . | Billie Rinaldi | Billie Rinaldi
HDFS-13195 | DataNode conf page cannot display the current value after reconfig | Minor | datanode | maobaolong | maobaolong
HADOOP-14067 | VersionInfo should load version-info.properties from its own classloader | Major | common | Thejas M Nair | Thejas M Nair
YARN-8063 | DistributedShellTimelinePlugin wrongly check for entityId instead of entityType | Major | . | Rohith Sharma K S | Rohith Sharma K S
YARN-8062 | yarn rmadmin -getGroups returns group from which the user has been removed | Critical | . | Sumana Sathish | Sunil Govindan
YARN-8068 | Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ | Blocker | yarn | Sunil Govindan | Sunil Govindan
YARN-8075 | DShell does not fail when we ask more GPUs than available even though AM throws ‘InvalidResourceRequestException’ | Major | . | Sumana Sathish | Wangda Tan
HADOOP-15320 | Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake | Major | fs/adl, fs/azure | shanyu zhao | shanyu zhao
YARN-8085 | ResourceProfilesManager should be set in RMActiveServiceContext | Blocker | capacityscheduler | Tao Yang | Tao Yang
YARN-8086 | ManagedParentQueue with no leaf queues cause JS error in new UI | Blocker | . | Suma Shivaprasad | Suma Shivaprasad
YARN-6629 | NPE occurred when container allocation proposal is applied but its resource requests are removed before | Critical | . | Tao Yang | Tao Yang
MAPREDUCE-7036 | ASF License warning in hadoop-mapreduce-client | Minor | test | Takanobu Asanuma | Takanobu Asanuma
YARN-7527 | Over-allocate node resource in async-scheduling mode of CapacityScheduler | Major | capacityscheduler | Tao Yang | Tao Yang
YARN-7598 | Document how to use classpath isolation for aux-services in YARN | Major | . | Xuan Gong | Xuan Gong
HDFS-13136 | Avoid taking FSN lock while doing group member lookup for FSD permission check | Major | namenode | Xiaoyu Yao | Xiaoyu Yao
HADOOP-15450 | Avoid fsync storm triggered by DiskChecker and handle disk full situation | Blocker | . | Kihwal Lee | Arpit Agarwal
YARN-8346 | Upgrading to 3.1 kills running containers with error “Opportunistic container queue is full” | Blocker | . | Rohith Sharma K S | Jason Lowe
HADOOP-9747 | Reduce unnecessary UGI synchronization | Critical | security | Daryn Sharp | Daryn Sharp

### TESTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-6953 | Skip the testcase testJobWithChangePriority if FairScheduler is used | Major | client | Peter Bacsko | Peter Bacsko
HDFS-12730 | Verify open files captured in the snapshots across config disable and enable | Major | hdfs | Manoj Govindassamy | Manoj Govindassamy
HADOOP-15117 | open(PathHandle) contract test should be exhaustive for default options | Major | . | Chris Douglas | Chris Douglas
HDFS-13106 | Need to exercise all HDFS APIs for EC | Major | hdfs | Haibo Yan | Haibo Yan
HDFS-13107 | Add Mover Cli Unit Tests for Federated cluster | Major | balancer & mover, test | Bharat Viswanadham | Bharat Viswanadham
HDFS-13550 | TestDebugAdmin#testComputeMetaCommand fails on Windows | Minor | . | Anbang Hu | Anbang Hu

### SUB-TASKS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
YARN-4081 | Add support for multiple resource types in the Resource class | Major | resourcemanager | Varun Vasudev | Varun Vasudev
YARN-4172 | Extend DominantResourceCalculator to account for all resources | Major | resourcemanager | Varun Vasudev | Varun Vasudev
YARN-4715 | Add support to read resource types from a config file | Major | nodemanager, resourcemanager | Varun Vasudev | Varun Vasudev
YARN-4829 | Add support for binary units | Major | nodemanager, resourcemanager | Varun Vasudev | Varun Vasudev
YARN-4830 | Add support for resource types in the nodemanager | Major | nodemanager | Varun Vasudev | Varun Vasudev
YARN-5242 | Update DominantResourceCalculator to consider all resource types in calculations | Major | resourcemanager | Varun Vasudev | Varun Vasudev
YARN-5586 | Update the Resources class to consider all resource types | Major | nodemanager, resourcemanager | Varun Vasudev | Varun Vasudev
YARN-5707 | Add manager class for resource profiles | Major | resourcemanager | Varun Vasudev | Varun Vasudev
YARN-5708 | Implement APIs to get resource profiles from the RM | Major | client | Varun Vasudev | Varun Vasudev
YARN-5587 | Add support for resource profiles | Major | nodemanager, resourcemanager | Varun Vasudev | Varun Vasudev
YARN-5951 | Changes to allow CapacityScheduler to use configuration store | Major | . | Jonathan Hung | Jonathan Hung
YARN-5946 | Create YarnConfigurationStore interface and InMemoryConfigurationStore class | Major | . | Jonathan Hung | Jonathan Hung
YARN-5588 | Add support for resource profiles in distributed shell | Major | nodemanager, resourcemanager | Varun Vasudev | Varun Vasudev
YARN-6232 | Update resource usage and preempted resource calculations to take into account all resource types | Major | resourcemanager | Varun Vasudev | Varun Vasudev
YARN-5948 | Implement MutableConfigurationManager for handling storage into configuration store | Major | . | Jonathan Hung | Jonathan Hung
YARN-5952 | Create REST API for changing YARN scheduler configurations | Major | . | Jonathan Hung | Jonathan Hung
HDFS-10706 | [READ] Add tool generating FSImage from external store | Major | namenode, tools | Chris Douglas | Chris Douglas
YARN-6445 | [YARN-3926] Performance improvements in resource profile branch with respect to SLS | Major | nodemanager, resourcemanager | Varun Vasudev | Varun Vasudev
HDFS-11653 | [READ] ProvidedReplica should return an InputStream that is bounded by its length | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-11663 | [READ] Fix NullPointerException in ProvidedBlocksBuilder | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-11703 | [READ] Tests for ProvidedStorageMap | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-5949 | Add pluggable configuration ACL policy interface and implementation | Major | . | Jonathan Hung | Jonathan Hung
HDFS-11791 | [READ] Test for increasing replication of provided files. | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-11792 | [READ] Test cases for ProvidedVolumeDF and ProviderBlockIteratorImpl | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-11673 | [READ] Handle failures of Datanode with PROVIDED storage | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-6575 | Support global configuration mutation in MutableConfProvider | Major | . | Jonathan Hung | Jonathan Hung
YARN-5953 | Create CLI for changing YARN configurations | Major | . | Jonathan Hung | Jonathan Hung
YARN-6761 | Fix build for YARN-3926 branch | Major | nodemanager, resourcemanager | Varun Vasudev | Varun Vasudev
YARN-6786 | ResourcePBImpl imports cleanup | Trivial | resourcemanager | Daniel Templeton | Yeliang Cang
YARN-5947 | Create LeveldbConfigurationStore class using Leveldb as backing store | Major | . | Jonathan Hung | Jonathan Hung
YARN-6322 | Disable queue refresh when configuration mutation is enabled | Major | . | Jonathan Hung | Jonathan Hung
YARN-6593 | [API] Introduce Placement Constraint object | Major | . | Konstantinos Karanasos | Konstantinos Karanasos
YARN-6788 | Improve performance of resource profile branch | Blocker | nodemanager, resourcemanager | Sunil Govindan | Sunil Govindan
HDFS-12091 | [READ] Check that the replicas served from a {{ProvidedVolumeImpl}} belong to the correct external storage | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-12093 | [READ] Share remoteFS between ProvidedReplica instances. | Major | . | Ewan Higgs | Virajith Jalaparti
YARN-6471 | Support to add min/max resource configuration for a queue | Major | capacity scheduler | Sunil Govindan | Sunil Govindan
YARN-6935 | ResourceProfilesManagerImpl.parseResource() has no need of the key parameter | Major | resourcemanager | Daniel Templeton | Manikandan R
HDFS-12289 | [READ] HDFS-12091 breaks the tests for provided block reads | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-6994 | Remove last uses of Long from resource types code | Minor | resourcemanager | Daniel Templeton | Daniel Templeton
YARN-6892 | Improve API implementation in Resources and DominantResourceCalculator class | Major | nodemanager, resourcemanager | Sunil Govindan | Sunil Govindan
YARN-6908 | ResourceProfilesManagerImpl is missing @Overrides on methods | Minor | resourcemanager | Daniel Templeton | Sunil Govindan
YARN-6610 | DominantResourceCalculator#getResourceAsValue dominant param is updated to handle multiple resources | Critical | resourcemanager | Daniel Templeton | Daniel Templeton
YARN-7030 | Performance optimizations in Resource and ResourceUtils class | Critical | nodemanager, resourcemanager | Wangda Tan | Wangda Tan
YARN-7042 | Clean up unit tests after YARN-6610 | Major | test | Daniel Templeton | Daniel Templeton
YARN-6789 | Add Client API to get all supported resource types from RM | Major | nodemanager, resourcemanager | Sunil Govindan | Sunil Govindan
YARN-6781 | ResourceUtils#initializeResourcesMap takes an unnecessary Map parameter | Minor | resourcemanager | Daniel Templeton | Yu-Tang Lin
YARN-7043 | Cleanup ResourceProfileManager | Critical | . | Wangda Tan | Wangda Tan
YARN-7067 | Optimize ResourceType information display in UI | Critical | nodemanager, resourcemanager | Wangda Tan | Wangda Tan
YARN-7039 | Fix javac and javadoc errors in YARN-3926 branch | Major | nodemanager, resourcemanager | Sunil Govindan | Sunil Govindan
YARN-7024 | Fix issues on recovery in LevelDB store | Major | . | Jonathan Hung | Jonathan Hung
YARN-7093 | Improve log message in ResourceUtils | Trivial | nodemanager, resourcemanager | Sunil Govindan | Sunil Govindan
YARN-7075 | Better styling for donut charts in new YARN UI | Major | . | Da Ding | Da Ding
HADOOP-14103 | Sort out hadoop-aws contract-test-options.xml | Minor | fs/s3, test | Steve Loughran | John Zhuge
YARN-6933 | ResourceUtils.DISALLOWED_NAMES check is duplicated | Major | resourcemanager | Daniel Templeton | Manikandan R
YARN-5328 | Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem | Major | resourcemanager | Subru Krishnan | Subru Krishnan
YARN-7056 | Document Resource Profiles feature | Major | nodemanager, resourcemanager | Sunil Govindan | Sunil Govindan
YARN-7144 | Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader. | Major | . | Xuan Gong | Xuan Gong
YARN-7104 | Improve Nodes Heatmap in new YARN UI with better color coding | Major | . | Da Ding | Da Ding
YARN-6600 | Introduce default and max lifetime of application at LeafQueue level | Major | capacity scheduler | Rohith Sharma K S | Rohith Sharma K S
YARN-5330 | SharingPolicy enhancements required to support recurring reservations in ReservationSystem | Major | resourcemanager | Subru Krishnan | Carlo Curino
YARN-7072 | Add a new log aggregation file format controller | Major | . | Xuan Gong | Xuan Gong
YARN-7136 | Additional Performance Improvement for Resource Profile Feature | Critical | nodemanager, resourcemanager | Wangda Tan | Wangda Tan
YARN-7137 | Move newly added APIs to unstable in YARN-3926 branch | Blocker | nodemanager, resourcemanager | Wangda Tan | Wangda Tan
YARN-7194 | Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormat | Major | . | Xuan Gong | Xuan Gong
YARN-6612 | Update fair scheduler policies to be aware of resource types | Major | fairscheduler | Daniel Templeton | Daniel Templeton
YARN-7174 | Add retry logic in LogsCLI when fetch running application logs | Major | . | Xuan Gong | Xuan Gong
YARN-6840 | Implement zookeeper based store for scheduler configuration updates | Major | . | Wangda Tan | Jonathan Hung
HDFS-12473 | Change hosts JSON file format | Major | . | Ming Ma | Ming Ma
HDFS-11035 | Better documentation for maintenace mode and upgrade domain | Major | datanode, documentation | Wei-Chiu Chuang | Ming Ma
YARN-7046 | Add closing logic to configuration store | Major | . | Jonathan Hung | Jonathan Hung
MAPREDUCE-6947 | Moving logging APIs over to slf4j in hadoop-mapreduce-examples | Major | . | Gergely Novák | Gergely Novák
HADOOP-14894 | ReflectionUtils should use Time.monotonicNow to mesaure duration | Minor | . | Bharat Viswanadham | Bharat Viswanadham
HADOOP-14892 | MetricsSystemImpl should use Time.monotonicNow for measuring durations | Minor | . | Chetna Chaudhari | Chetna Chaudhari
YARN-7238 | Documentation for API based scheduler configuration management | Major | . | Jonathan Hung | Jonathan Hung
HADOOP-14893 | WritableRpcEngine should use Time.monotonicNow | Minor | . | Chetna Chaudhari | Chetna Chaudhari
HDFS-12386 | Add fsserver defaults call to WebhdfsFileSystem. | Minor | webhdfs | Rushabh S Shah | Rushabh S Shah
YARN-7252 | Removing queue then failing over results in exception | Critical | . | Jonathan Hung | Jonathan Hung
YARN-7251 | Misc changes to YARN-5734 | Major | . | Jonathan Hung | Jonathan Hung
YARN-6962 | Add support for updateContainers when allocating using FederationInterceptor | Minor | . | Botong Huang | Botong Huang
YARN-7259 | Add size-based rolling policy to LogAggregationIndexedFileController | Major | . | Xuan Gong | Xuan Gong
MAPREDUCE-6971 | Moving logging APIs over to slf4j in hadoop-mapreduce-client-app | Major | . | Jinjiang Ling | Jinjiang Ling
YARN-6916 | Moving logging APIs over to slf4j in hadoop-yarn-server-common | Major | . | Akira Ajisaka | Akira Ajisaka
HDFS-12584 | [READ] Fix errors in image generation tool from latest rebase | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-6975 | Moving logging APIs over to slf4j in hadoop-yarn-server-tests, hadoop-yarn-server-web-proxy and hadoop-yarn-server-router | Major | . | Yeliang Cang | Yeliang Cang
YARN-2037 | Add work preserving restart support for Unmanaged AMs | Major | resourcemanager | Karthik Kambatla | Botong Huang
YARN-5329 | Placement Agent enhancements required to support recurring reservations in ReservationSystem | Blocker | resourcemanager | Subru Krishnan | Carlo Curino
YARN-6182 | Fix alignment issues and missing information in new YARN UI’s Queue page | Major | yarn-ui-v2 | Akhil PB | Akhil PB
HADOOP-14845 | Azure wasb: getFileStatus not making any auth checks | Major | fs/azure, security | Sivaguru Sankaridurg | Sivaguru Sankaridurg
HADOOP-14899 | Restrict Access to setPermission operation when authorization is enabled in WASB | Major | fs/azure | Kannapiran Srinivasan | Kannapiran Srinivasan
YARN-7237 | Cleanup usages of ResourceProfiles | Critical | nodemanager, resourcemanager | Wangda Tan | Wangda Tan
YARN-7296 | convertToProtoFormat(Resource r) is not setting for all resource types | Major | . | lovekesh bansal | lovekesh bansal
HADOOP-14913 | Sticky bit implementation for rename() operation in Azure WASB | Major | fs, fs/azure | Varada Hemeswari | Varada Hemeswari
YARN-6620 | Add support in NodeManager to isolate GPU devices by using CGroups | Major | . | Wangda Tan | Wangda Tan
YARN-7205 | Log improvements for the ResourceUtils | Major | nodemanager, resourcemanager | Jian He | Sunil Govindan
YARN-7180 | Remove class ResourceType | Major | resourcemanager, scheduler | Yufei Gu | Sunil Govindan
HADOOP-14935 | Azure: POSIX permissions are taking effect in access() method even when authorization is enabled | Major | fs/azure | Santhosh G Nayak | Santhosh G Nayak
YARN-7254 | UI and metrics changes related to absolute resource configuration | Major | capacity scheduler | Sunil Govindan | Sunil Govindan
YARN-7311 | Fix TestRMWebServicesReservation parametrization for fair scheduler | Blocker | fairscheduler, reservation system | Yufei Gu | Yufei Gu
HDFS-12605 | [READ] TestNameNodeProvidedImplementation#testProvidedDatanodeFailures fails after rebase | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-7345 | GPU Isolation: Incorrect minor device numbers written to devices.deny file | Major | . | Jonathan Hung | Jonathan Hung
YARN-7338 | Support same origin policy for cross site scripting prevention. | Major | yarn-ui-v2 | Vrushali C | Sunil Govindan
YARN-4090 | Make Collections.sort() more efficient by caching resource usage | Major | fairscheduler | Xianyin Xin | Yufei Gu
YARN-6984 | DominantResourceCalculator.isAnyMajorResourceZero() should test all resources | Major | scheduler | Daniel Templeton | Sunil Govindan
YARN-4827 | Document configuration of ReservationSystem for FairScheduler | Blocker | capacity scheduler | Subru Krishnan | Yufei Gu
YARN-5516 | Add REST API for supporting recurring reservations | Major | resourcemanager | Sangeetha Abdu Jyothi | Sean Po
MAPREDUCE-6977 | Moving logging APIs over to slf4j in hadoop-mapreduce-client-common | Major | client | Jinjiang Ling | Jinjiang Ling
YARN-6505 | Define the strings used in SLS JSON input file format | Major | scheduler-load-simulator | Yufei Gu | Gergely Novák
YARN-7332 | Compute effectiveCapacity per each resource vector | Major | capacity scheduler | Sunil Govindan | Sunil Govindan
YARN-7224 | Support GPU isolation for docker container | Major | . | Wangda Tan | Wangda Tan
YARN-7374 | Improve performance of DRF comparisons for resource types in fair scheduler | Critical | fairscheduler | Daniel Templeton | Daniel Templeton
YARN-6927 | Add support for individual resource types requests in MapReduce | Major | resourcemanager | Daniel Templeton | Gergo Repas
YARN-6594 | [API] Introduce SchedulingRequest object | Major | . | Konstantinos Karanasos | Konstantinos Karanasos
HADOOP-14997 | Add hadoop-aliyun as dependency of hadoop-cloud-storage | Minor | fs/oss | Genmao Yu | Genmao Yu
YARN-7289 | Application lifetime does not work with FairScheduler | Major | resourcemanager | Miklos Szegedi | Miklos Szegedi
YARN-7392 | Render cluster information on new YARN web ui | Major | webapp | Vasudevan Skm | Vasudevan Skm
HDFS-11902 | [READ] Merge BlockFormatProvider and FileRegionProvider. | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-7307 | Allow client/AM update supported resource types via YARN APIs | Blocker | nodemanager, resourcemanager | Wangda Tan | Sunil Govindan
HDFS-12607 | [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-7394 | Merge code paths for Reservation/Plan queues and Auto Created queues | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
HDFS-12671 | [READ] Test NameNode restarts when PROVIDED is configured | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-12789 | [READ] Image generation tool does not close an opened stream | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-7166 | Container REST endpoints should report resource types | Major | resourcemanager | Daniel Templeton | Daniel Templeton
YARN-7143 | FileNotFound handling in ResourceUtils is inconsistent | Major | resourcemanager | Daniel Templeton | Daniel Templeton
HDFS-12776 | [READ] Increasing replication for PROVIDED files should create local replicas | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-12779 | [READ] Allow cluster id to be specified to the Image generation tool | Trivial | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-12777 | [READ] Reduce memory and CPU footprint for PROVIDED volumes. | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-7406 | Moving logging APIs over to slf4j in hadoop-yarn-api | Major | . | Yeliang Cang | Yeliang Cang
YARN-7442 | [YARN-7069] Limit format of resource type name | Blocker | nodemanager, resourcemanager | Wangda Tan | Wangda Tan
YARN-7369 | Improve the resource types docs | Major | docs | Daniel Templeton | Daniel Templeton
YARN-6595 | [API] Add Placement Constraints at the application level | Major | . | Konstantinos Karanasos | Arun Suresh
YARN-7411 | Inter-Queue preemption’s computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee | Major | resourcemanager | Sunil Govindan | Sunil Govindan
YARN-7488 | Make ServiceClient.getAppId method public to return ApplicationId for a service name | Major | . | Gour Saha | Gour Saha
HADOOP-14993 | AliyunOSS: Override listFiles and listLocatedStatus | Major | fs/oss | Genmao Yu | Genmao Yu
YARN-6953 | Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources() | Minor | resourcemanager | Daniel Templeton | Manikandan R
HDFS-12775 | [READ] Fix reporting of Provided volumes | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-7482 | Max applications calculation per queue has to be retrospected with absolute resource support | Major | capacity scheduler | Sunil Govindan | Sunil Govindan
YARN-7486 | Race condition in service AM that can cause NPE | Major | . | Jian He | Jian He
YARN-7503 | Configurable heap size / JVM opts in service AM | Major | . | Jonathan Hung | Jonathan Hung
YARN-7419 | CapacityScheduler: Allow auto leaf queue creation after queue mapping | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
YARN-7483 | CapacityScheduler test cases cleanup post YARN-5881 | Major | test | Sunil Govindan | Sunil Govindan
HDFS-12801 | RBF: Set MountTableResolver as default file resolver | Minor | . | Íñigo Goiri | Íñigo Goiri
YARN-7430 | Enable user re-mapping for Docker containers by default | Blocker | security, yarn | Eric Yang | Eric Yang
YARN-7218 | ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2 | Major | api, applications | Eric Yang | Eric Yang
YARN-7448 | [API] Add SchedulingRequest to the AllocateRequest | Major | . | Arun Suresh | Panagiotis Garefalakis
YARN-7529 | TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently | Major | . | Chandni Singh | Chandni Singh
YARN-6128 | Add support for AMRMProxy HA | Major | amrmproxy, nodemanager | Subru Krishnan | Botong Huang
HADOOP-15024 | AliyunOSS: support user agent configuration and include that & Hadoop version information to oss server | Major | fs, fs/oss | Sammi Chen | Sammi Chen
HDFS-12778 | [READ] Report multiple locations for PROVIDED blocks | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-5534 | Allow user provided Docker volume mount list | Major | yarn | luhuichun | Shane Kumpf
YARN-7330 | Add support to show GPU in UI including metrics | Blocker | . | Wangda Tan | Wangda Tan
YARN-7538 | Fix performance regression introduced by Capacity Scheduler absolute min/max resource refactoring | Major | capacity scheduler | Sunil Govindan | Sunil Govindan
YARN-7544 | Use queue-path.capacity/maximum-capacity to specify CapacityScheduler absolute min/max resources | Major | capacity scheduler | Sunil Govindan | Sunil Govindan
YARN-6168 | Restarted RM may not inform AM about all existing containers | Major | . | Billie Rinaldi | Chandni Singh
HDFS-12809 | [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}. | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-12858 | RBF: Add router admin commands usage in HDFS commands reference doc | Minor | documentation | Yiqun Lin | Yiqun Lin
YARN-7564 | Cleanup to fix checkstyle issues of YARN-5881 branch | Minor | . | Sunil Govindan | Sunil Govindan
YARN-7480 | Render tooltips on columns where text is clipped in new YARN UI | Major | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
YARN-7575 | NPE in scheduler UI when max-capacity is not configured | Major | capacity scheduler | Eric Payne | Sunil Govindan
YARN-7533 | Documentation for absolute resource support in Capacity Scheduler | Major | capacity scheduler | Sunil Govindan | Sunil Govindan
HDFS-12835 | RBF: Fix Javadoc parameter errors | Minor | . | Wei Yan | Wei Yan
YARN-7541 | Node updates don’t update the maximum cluster capability for resources other than CPU and memory | Critical | resourcemanager | Daniel Templeton | Daniel Templeton
YARN-7573 | Gpu Information page could be empty for nodes without GPU | Major | webapp, yarn-ui-v2 | Sunil Govindan | Sunil Govindan
HDFS-12685 | [READ] FsVolumeImpl exception when scanning Provided storage volume | Major | . | Ewan Higgs | Virajith Jalaparti
HDFS-12665 | [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb) | Major | . | Ewan Higgs | Ewan Higgs
YARN-7487 | Ensure volume to include GPU base libraries after created by plugin | Major | . | Wangda Tan | Wangda Tan
YARN-6507 | Add support in NodeManager to isolate FPGA devices with CGroups | Major | yarn | Zhankun Tang | Zhankun Tang
MAPREDUCE-6994 | Uploader tool for Distributed Cache Deploy code changes | Major | . | Miklos Szegedi | Miklos Szegedi
HDFS-12591 | [READ] Implement LevelDBFileRegionFormat | Minor | hdfs | Ewan Higgs | Ewan Higgs
YARN-6907 | Node information page in the old web UI should report resource types | Major | resourcemanager | Daniel Templeton | Gergely Novák
YARN-7587 | Skip dispatching opportunistic containers to nodes whose queue is already full | Major | . | Weiwei Yang | Weiwei Yang
HDFS-12396 | Webhdfs file system should get delegation token from kms provider. | Major | encryption, kms, webhdfs | Rushabh S Shah | Rushabh S Shah
YARN-7092 | Render application specific log under application tab in new YARN UI | Major | yarn-ui-v2 | Akhil PB | Akhil PB
HADOOP-15071 | s3a troubleshooting docs to add a couple more failure modes | Minor | documentation, fs/s3 | Steve Loughran | Steve Loughran
YARN-7438 | Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm | Major | . | Wangda Tan | Wangda Tan
HDFS-12885 | Add visibility/stability annotations | Trivial | . | Chris Douglas | Chris Douglas
HADOOP-14475 | Metrics of S3A don’t print out when enable it in Hadoop metrics property file | Major | fs/s3 | Yonger | Yonger
HDFS-12713 | [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata | Major | . | Virajith Jalaparti | Ewan Higgs
HDFS-12894 | [READ] Skip setting block count of ProvidedDatanodeStorageInfo on DN registration update | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-7610 | Extend Distributed Shell to support launching job with opportunistic containers | Major | applications/distributed-shell | Weiwei Yang | Weiwei Yang
HDFS-11640 | [READ] Datanodes should use a unique identifier when reading from external stores | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-12887 | [READ] Allow Datanodes with Provided volumes to start when blocks with the same id exist locally | Major | . | Virajith Jalaparti | Virajith Jalaparti
MAPREDUCE-6998 | Moving logging APIs over to slf4j in hadoop-mapreduce-client-jobclient | Major | . | Akira Ajisaka | Gergely Novák
MAPREDUCE-7000 | Moving logging APIs over to slf4j in hadoop-mapreduce-client-nativetask | Minor | . | Jinjiang Ling | Jinjiang Ling
HDFS-12874 | [READ] Documentation for provided storage | Major | . | Chris Douglas | Virajith Jalaparti
YARN-7522 | Introduce AllocationTagsManager to associate allocation tags to nodes | Major | . | Wangda Tan | Wangda Tan
HDFS-12905 | [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage. | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-12893 | [READ] Support replication of Provided blocks with non-default topologies. | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-7443 | Add native FPGA module support to do isolation with cgroups | Major | yarn | Zhankun Tang | Zhankun Tang
YARN-7473 | Implement Framework and policy for capacity management of auto created queues | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
YARN-7420 | YARN UI changes to depict auto created queues | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
YARN-7520 | Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
YARN-6704 | Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService | Major | . | Botong Huang | Botong Huang
YARN-7632 | Effective min and max resource need to be set for auto created leaf queues upon creation and capacity management | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
MAPREDUCE-7018 | Apply erasure coding properly to framework tarball and support plain tar | Major | . | Miklos Szegedi | Miklos Szegedi
HDFS-12875 | RBF: Complete logic for -readonly option of dfsrouteradmin add command | Major | . | Yiqun Lin | Íñigo Goiri
YARN-7634 | Queue ACL validations should validate parent queue ACLs before auto-creating leaf queues | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
YARN-7641 | Allow searchable filter for Application page log viewer in new YARN UI | Major | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
YARN-7383 | Node resource is not parsed correctly for resource names containing dot | Major | nodemanager, resourcemanager | Jonathan Hung | Gergely Novák
YARN-7643 | Handle recovery of applications in case of auto-created leaf queue mapping | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
HDFS-12912 | [READ] Fix configuration and implementation of LevelDB-based alias maps | Major | . | Virajith Jalaparti | Virajith Jalaparti
YARN-7119 | Support multiple resource types in rmadmin updateNodeResource command | Major | nodemanager, resourcemanager | Daniel Templeton | Manikandan R
YARN-7630 | Fix AMRMToken rollover handling in AMRMProxy | Minor | . | Botong Huang | Botong Huang
YARN-7565 | Yarn service pre-maturely releases the container after AM restart | Major | . | Chandni Singh | Chandni Singh
YARN-7638 | Unit tests related to preemption for auto created leaf queues feature | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
YARN-7633 | Documentation for auto queue creation feature and related configurations | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
HDFS-12712 | [9806] Code style cleanup | Minor | . | Íñigo Goiri | Virajith Jalaparti
HDFS-12903 | [READ] Fix closing streams in ImageWriter | Major | . | Íñigo Goiri | Virajith Jalaparti
YARN-7617 | Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started | Minor | applications/distributed-shell | Weiwei Yang | Weiwei Yang
HDFS-12937 | RBF: Add more unit tests for router admin commands | Major | test | Yiqun Lin | Yiqun Lin
YARN-7620 | Allow node partition filters on Queues page of new YARN UI | Major | yarn-ui-v2 | Vasudevan Skm | Vasudevan Skm
YARN-7670 | Modifications to the ResourceScheduler to support SchedulingRequests | Major | . | Arun Suresh | Arun Suresh
YARN-7032 | [ATSv2] NPE while starting hbase co-processor when HBase authorization is enabled. | Critical | . | Rohith Sharma K S | Rohith Sharma K S
HADOOP-14965 | s3a input stream “normal” fadvise mode to be adaptive | Major | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-15133 | [JDK9] Ignore com.sun.javadoc.* and com.sun.tools.* in animal-sniffer-maven-plugin to compile with Java 9 | Major | . | Akira Ajisaka | Akira Ajisaka
YARN-7669 | API and interface modifications for placement constraint processor | Major | . | Arun Suresh | Arun Suresh
HADOOP-15113 | NPE in S3A getFileStatus: null instrumentation on using closed instance | Major | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-15086 | NativeAzureFileSystem file rename is not atomic | Major | fs/azure | Shixiong Zhu | Thomas Marquardt
YARN-7653 | Rack cardinality support for AllocationTagsManager | Major | . | Panagiotis Garefalakis | Panagiotis Garefalakis
YARN-6596 | Introduce Placement Constraint Manager module | Major | . | Konstantinos Karanasos | Konstantinos Karanasos
YARN-7612 | Add Processor Framework for Rich Placement Constraints | Major | . | Arun Suresh | Arun Suresh
YARN-7613 | Implement Basic algorithm for constraint based placement | Major | . | Arun Suresh | Panagiotis Garefalakis
YARN-7682 | Expose canSatisfyConstraints utility function to validate a placement against a constraint | Major | . | Arun Suresh | Panagiotis Garefalakis
HDFS-12988 | RBF: Mount table entries not properly updated in the local cache | Major | . | Íñigo Goiri | Íñigo Goiri
YARN-7557 | It should be possible to specify resource types in the fair scheduler increment value | Critical | fairscheduler | Daniel Templeton | Gergo Repas
YARN-7666 | Introduce scheduler specific environment variable support in ApplicationSubmissionContext for better scheduling placement configurations | Major | . | Sunil Govindan | Sunil Govindan
YARN-7242 | Support to specify values of different resource types in DistributedShell for easier testing | Critical | nodemanager, resourcemanager | Wangda Tan | Gergely Novák
YARN-7704 | Document improvement for registry dns | Major | . | Jian He | Jian He
HADOOP-15161 | s3a: Stream and common statistics missing from metrics | Major | . | Sean Mackrory | Sean Mackrory
HDFS-12802 | RBF: Control MountTableResolver cache size | Major | . | Íñigo Goiri | Íñigo Goiri
HDFS-12934 | RBF: Federation supports global quota | Major | . | Yiqun Lin | Yiqun Lin
YARN-7681 | Double-check placement constraints in scheduling phase before actual allocation is made | Major | RM, scheduler | Weiwei Yang | Weiwei Yang
YARN-5366 | Improve handling of the Docker container life cycle | Major | yarn | Shane Kumpf | Shane Kumpf
MAPREDUCE-7030 | Uploader tool should ignore symlinks to the same directory | Minor | . | Miklos Szegedi | Miklos Szegedi
YARN-7724 | yarn application status should support application name | Major | yarn-native-services | Yesha Vora | Jian He
YARN-7696 | Add container tags to ContainerTokenIdentifier, api.Container and NMContainerStatus to handle all recovery cases | Major | . | Arun Suresh | Arun Suresh
HDFS-12972 | RBF: Display mount table quota info in Web UI and admin command | Major | . | Yiqun Lin | Yiqun Lin
MAPREDUCE-7034 | Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce | Major | . | Takanobu Asanuma | Takanobu Asanuma
HADOOP-15079 | ITestS3AFileOperationCost#testFakeDirectoryDeletion failing after OutputCommitter patch | Critical | . | Sean Mackrory | Steve Loughran
HDFS-12919 | RBF: Support erasure coding methods in RouterRpcServer | Critical | . | Íñigo Goiri | Íñigo Goiri
YARN-6736 | Consider writing to both ats v1 & v2 from RM for smoother upgrades | Major | timelineserver | Vrushali C | Aaron Gresch
MAPREDUCE-7032 | Add the ability to specify a delayed replication count | Major | . | Miklos Szegedi | Miklos Szegedi
HADOOP-15141 | Support IAM Assumed roles in S3A | Major | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-15027 | AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance | Major | fs/oss | wujinhu | wujinhu
YARN-6619 | AMRMClient Changes to use the PlacementConstraint and SchcedulingRequest objects | Major | . | Arun Suresh | Arun Suresh
YARN-7709 | Remove SELF from TargetExpression type | Blocker | . | Wangda Tan | Konstantinos Karanasos
YARN-6599 | Support anti-affinity constraint via AppPlacementAllocator | Major | . | Wangda Tan | Wangda Tan
YARN-7745 | Allow DistributedShell to take a placement specification for containers it wants to launch | Major | . | Arun Suresh | Arun Suresh
HDFS-12973 | RBF: Document global quota supporting in federation | Major | . | Yiqun Lin | Yiqun Lin
HDFS-13028 | RBF: Fix spurious TestRouterRpc#testProxyGetStats | Minor | . | Íñigo Goiri | Íñigo Goiri
YARN-5094 | some YARN container events have timestamp of -1 | Critical | . | Sangjin Lee | Haibo Chen
MAPREDUCE-6995 | Uploader tool for Distributed Cache Deploy documentation | Major | . | Miklos Szegedi | Miklos Szegedi
YARN-7774 | Miscellaneous fixes to the PlacementProcessor | Blocker | . | Arun Suresh | Arun Suresh
YARN-7763 | Allow Constraints specified in the SchedulingRequest to override application level constraints | Blocker | . | Wangda Tan | Weiwei Yang
YARN-7729 | Add support for setting the PID namespace mode | Major | nodemanager | Shane Kumpf | Billie Rinaldi
YARN-7788 | Factor out management of temp tags from AllocationTagsManager | Major | . | Arun Suresh | Arun Suresh
YARN-7779 | Display allocation tags in RM web UI and expose same through REST API | Major | RM | Weiwei Yang | Weiwei Yang
YARN-7782 | Enable user re-mapping for Docker containers in yarn-default.xml | Blocker | security, yarn | Eric Yang | Eric Yang
YARN-7605 | Implement doAs for Api Service REST API | Major | . | Eric Yang | Eric Yang
YARN-7540 | Convert yarn app cli to call yarn api services | Major | . | Eric Yang | Eric Yang
HDFS-12772 | RBF: Federation Router State State Store internal API | Major | . | Íñigo Goiri | Íñigo Goiri
YARN-7783 | Add validation step to ensure constraints are not violated due to order in which a request is processed | Blocker | . | Arun Suresh | Arun Suresh
YARN-7807 | Assume intra-app anti-affinity as default for scheduling request inside AppPlacementAllocator | Blocker | . | Wangda Tan | Wangda Tan
YARN-7795 | Fix jenkins issues of YARN-6592 branch | Blocker | . | Sunil Govindan | Sunil Govindan
HDFS-13042 | RBF: Heartbeat Router State | Major | . | Íñigo Goiri | Íñigo Goiri
YARN-7798 | Refactor SLS Reservation Creation | Minor | . | Young Chen | Young Chen
HDFS-13049 | RBF: Inconsistent Router OPTS config in branch-2 and branch-3 | Minor | . | Wei Yan | Wei Yan
YARN-7814 | Remove automatic mounting of the cgroups root directory into Docker containers | Major | . | Shane Kumpf | Shane Kumpf
YARN-7784 | Fix Cluster metrics when placement processor is enabled | Major | metrics, RM | Weiwei Yang | Arun Suresh
YARN-6597 | Add RMContainer recovery test to verify tag population in the AllocationTagsManager | Major | . | Konstantinos Karanasos | Panagiotis Garefalakis
YARN-7817 | Add Resource reference to RM’s NodeInfo object so REST API can get non memory/vcore resource usages. | Major | . | Sumana Sathish | Sunil Govindan
YARN-7797 | Docker host network can not obtain IP address for RegistryDNS | Major | nodemanager | Eric Yang | Eric Yang
HDFS-12574 | Add CryptoInputStream to WebHdfsFileSystem read call. | Major | encryption, kms, webhdfs | Rushabh S Shah | Rushabh S Shah
YARN-5148 | [UI2] Add page to new YARN UI to view server side configurations/logs/JVM-metrics | Major | webapp, yarn-ui-v2 | Wangda Tan | Kai Sasaki
YARN-7723 | Avoid using docker volume –format option to run against older docker releases | Major | . | Wangda Tan | Wangda Tan
YARN-7780 | Documentation for Placement Constraints | Major | . | Arun Suresh | Konstantinos Karanasos
YARN-7811 | Service AM should use configured default docker network | Major | yarn-native-services | Billie Rinaldi | Billie Rinaldi
YARN-7822 | Constraint satisfaction checker support for composite OR and AND constraints | Major | . | Arun Suresh | Weiwei Yang
HDFS-13044 | RBF: Add a safe mode for the Router | Major | . | Íñigo Goiri | Íñigo Goiri
YARN-7816 | YARN Service - Two different users are unable to launch a service of the same name | Major | applications | Gour Saha | Gour Saha
HDFS-13043 | RBF: Expose the state of the Routers in the federation | Major | . | Íñigo Goiri | Íñigo Goiri
HDFS-12997 | Move logging to slf4j in BlockPoolSliceStorage and Storage | Major | . | Ajay Kumar | Ajay Kumar
HDFS-13068 | RBF: Add router admin option to manage safe mode | Major | . | Íñigo Goiri | Yiqun Lin
YARN-7839 | Modify PlacementAlgorithm to Check node capacity before placing request on node | Major | . | Arun Suresh | Panagiotis Garefalakis
YARN-7868 | Provide improved error message when YARN service is disabled | Major | yarn-native-services | Eric Yang | Eric Yang
YARN-7778 | Merging of placement constraints defined at different levels | Major | . | Konstantinos Karanasos | Weiwei Yang
YARN-7860 | Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning | Major | . | Weiwei Yang | Sunil Govindan
YARN-7516 | Security check for trusted docker image | Major | . | Eric Yang | Eric Yang
YARN-7815 | Make the YARN mounts added to Docker containers more restrictive | Major | . | Shane Kumpf | Shane Kumpf
HADOOP-15214 | Make Hadoop compatible with Guava 21.0 | Minor | . | Igor Dvorzhak | Igor Dvorzhak
YARN-5428 | Allow for specifying the docker client configuration directory | Major | yarn | Shane Kumpf | Shane Kumpf
YARN-7838 | Support AND/OR constraints in Distributed Shell | Critical | distributed-shell | Weiwei Yang | Weiwei Yang
HADOOP-13974 | S3Guard CLI to support list/purge of pending multipart commits | Major | fs/s3 | Steve Loughran | Aaron Fabbri
YARN-7917 | Fix failing test TestDockerContainerRuntime#testLaunchContainerWithDockerTokens | Minor | nodemanager | Shane Kumpf | Shane Kumpf
YARN-7914 | Fix exit code handling for short lived Docker containers | Critical | . | Shane Kumpf | Shane Kumpf
HADOOP-15040 | Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation | Blocker | fs/s3 | Aaron Fabbri | Aaron Fabbri
YARN-7789 | Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator | Critical | . | Sumana Sathish | Zian Chen
HADOOP-15076 | Enhance S3A troubleshooting documents and add a performance document | Blocker | documentation, fs/s3 | Steve Loughran | Steve Loughran
HADOOP-15176 | Enhance IAM Assumed Role support in S3A client | Blocker | fs/s3, test | Steve Loughran | Steve Loughran
YARN-7920 | Simplify configuration for PlacementConstraints | Blocker | . | Wangda Tan | Wangda Tan
YARN-7292 | Retrospect Resource Profile Behavior for overriding capability | Blocker | nodemanager, resourcemanager | Wangda Tan | Wangda Tan
HADOOP-14507 | extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret.key | Critical | fs/s3 | Steve Loughran | Steve Loughran
YARN-7328 | ResourceUtils allows yarn.nodemanager.resource-types.memory-mb and .vcores to override yarn.nodemanager.resource.memory-mb and .cpu-vcores | Critical | nodemanager | Daniel Templeton | lovekesh bansal
HDFS-13119 | RBF: Manage unavailable clusters | Major | . | Íñigo Goiri | Yiqun Lin
YARN-7940 | Service AM gets NoAuth with secure ZK | Blocker | yarn-native-services | Billie Rinaldi | Billie Rinaldi
YARN-7223 | Document GPU isolation feature | Blocker | . | Wangda Tan | Wangda Tan
HADOOP-15247 | Move commons-net up to 3.6 | Minor | fs | Steve Loughran | Steve Loughran
YARN-7916 | Remove call to docker logs on failure in container-executor | Major | . | Shane Kumpf | Shane Kumpf
YARN-7836 | YARN Service component update PUT API should not use component name from JSON body | Major | api, yarn-native-services | Gour Saha | Gour Saha
YARN-7934 | [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos | Major | . | Carlo Curino | Carlo Curino
YARN-7921 | Transform a PlacementConstraint to a string expression | Major | . | Weiwei Yang | Weiwei Yang
HDFS-13187 | RBF: Fix Routers information shown in the web UI | Minor | . | Wei Yan | Wei Yan
HDFS-13184 | RBF: Improve the unit test TestRouterRPCClientRetries | Minor | test | Yiqun Lin | Yiqun Lin
YARN-7893 | Document the FPGA isolation feature | Blocker | . | Zhankun Tang | Zhankun Tang
YARN-7959 | Add .vm extension to PlacementConstraints.md to ensure proper filtering | Critical | documentation | Weiwei Yang | Weiwei Yang
HDFS-13199 | RBF: Fix the hdfs router page missing label icon issue | Major | federation, hdfs | maobaolong | maobaolong
YARN-7929 | Support to set container execution type in SLS | Major | scheduler-load-simulator | Jiandan Yang | Jiandan Yang
HADOOP-15264 | AWS “shaded” SDK 1.11.271 is pulling in netty 4.1.17 | Blocker | fs/s3 | Steve Loughran | Steve Loughran
YARN-7446 | Docker container privileged mode and –user flag contradict each other | Major | . | Eric Yang | Eric Yang
YARN-7954 | Component status stays “Ready” when yarn service is stopped | Major | . | Yesha Vora | Gour Saha
YARN-7955 | Calling stop on an already stopped service says “Successfully stopped service” | Major | . | Gour Saha | Gour Saha
YARN-7637 | GPU volume creation command fails when work preserving is disabled at NM | Critical | nodemanager | Sunil Govindan | Zian Chen
HADOOP-15274 | Move hadoop-openstack to slf4j | Minor | fs/swift | Steve Loughran | fang zhenyi
HADOOP-14652 | Update metrics-core version to 3.2.4 | Major | . | Ray Chiang | Ray Chiang
HDFS-1686 | Federation: Add more Balancer tests with federation setting | Minor | balancer & mover, test | Tsz Wo Nicholas Sze | Bharat Viswanadham
HADOOP-13761 | S3Guard: implement retries for DDB failures and throttling; translate exceptions | Blocker | fs/s3 | Aaron Fabbri | Aaron Fabbri
YARN-7915 | Trusted image log message repeated multiple times | Major | . | Eric Badger | Shane Kumpf
HADOOP-15090 | Add ADL troubleshooting doc | Major | documentation, fs/adl | Steve Loughran | Steve Loughran
YARN-7972 | Support inter-app placement constraints for allocation tags by application ID | Major | . | Weiwei Yang | Weiwei Yang
HADOOP-15271 | Remove unicode multibyte characters from JavaDoc | Major | documentation | Akira Ajisaka | Takanobu Asanuma
HADOOP-15287 | JDK9 JavaDoc build fails due to one-character underscore identifiers in hadoop-yarn-common | Major | documentation | Takanobu Asanuma | Takanobu Asanuma
HADOOP-15291 | TestMiniKdc fails on Java 9 | Major | test | Akira Ajisaka | Takanobu Asanuma
YARN-7346 | Add a profile to allow optional compilation for ATSv2 with HBase-2.0 | Major | . | Ted Yu | Haibo Chen
YARN-7919 | Refactor timelineservice-hbase module into submodules | Major | timelineservice | Haibo Chen | Haibo Chen
HDFS-13214 | RBF: Complete document of Router configuration | Major | . | Tao Jie | Yiqun Lin
HADOOP-15267 | S3A multipart upload fails when SSE-C encryption is enabled | Critical | fs/s3 | Anis Elleuch | Anis Elleuch
YARN-7891 | LogAggregationIndexedFileController should support read from HAR file | Major | . | Xuan Gong | Xuan Gong
YARN-7626 | Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount | Major | . | Zian Chen | Zian Chen
HDFS-13230 | RBF: ConnectionManager’s cleanup task will compare each pool’s own active conns with its total conns | Minor | . | Wei Yan | Chao Sun
HDFS-13233 | RBF: MountTableResolver doesn’t return the correct mount point of the given path | Major | hdfs | wangzhiyuan | wangzhiyuan
HADOOP-15277 | remove .FluentPropertyBeanIntrospector from CLI operation log output | Minor | conf | Steve Loughran | Steve Loughran
HADOOP-15293 | TestLogLevel fails on Java 9 | Major | test | Akira Ajisaka | Takanobu Asanuma
HDFS-13212 | RBF: Fix router location cache issue | Major | federation, hdfs | Weiwei Wu | Weiwei Wu
HDFS-13232 | RBF: ConnectionPool should return first usable connection | Minor | . | Wei Yan | Ekanth Sethuramalingam
HDFS-13240 | RBF: Update some inaccurate document descriptions | Minor | . | Yiqun Lin | Yiqun Lin
YARN-7523 | Introduce description and version field in Service record | Critical | . | Gour Saha | Chandni Singh
HADOOP-15297 | Make S3A etag => checksum feature optional | Blocker | fs/s3 | Steve Loughran | Steve Loughran
HDFS-11399 | Many tests fails in Windows due to injecting disk failures | Major | . | Yiqun Lin | Yiqun Lin
HDFS-12677 | Extend TestReconstructStripedFile with a random EC policy | Major | erasure-coding, test | Takanobu Asanuma | Takanobu Asanuma
HDFS-13241 | RBF: TestRouterSafemode failed if the port 8888 is in use | Major | hdfs, test | maobaolong | maobaolong
HDFS-13253 | RBF: Quota management incorrect parent-child relationship judgement | Major | . | Yiqun Lin | Yiqun Lin
HDFS-13226 | RBF: Throw the exception if mount table entry validated failed | Major | hdfs | maobaolong | maobaolong
HDFS-12505 | Extend TestFileStatusWithECPolicy with a random EC policy | Major | erasure-coding, test | Takanobu Asanuma | Takanobu Asanuma
HDFS-12587 | Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies | Major | erasure-coding, test | Takanobu Asanuma | Takanobu Asanuma
YARN-5015 | Support sliding window retry capability for container restart | Major | nodemanager | Varun Vasudev | Chandni Singh
YARN-7657 | Queue Mapping could provide options to provide ‘user’ specific auto-created queues under a specified group parent queue | Major | capacity scheduler | Suma Shivaprasad | Suma Shivaprasad
HADOOP-15308 | TestConfiguration fails on Windows because of paths | Major | test | Íñigo Goiri | Xiao Liang
HDFS-12773 | RBF: Improve State Store FS implementation | Major | . | Íñigo Goiri | Íñigo Goiri
HADOOP-15294 | TestUGILoginFromKeytab fails on Java9 | Major | security | Takanobu Asanuma | Takanobu Asanuma
YARN-7999 | Docker launch fails when user private filecache directory is missing | Major | . | Eric Yang | Jason Lowe
HDFS-13198 | RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router | Minor | . | Wei Yan | Wei Yan
HADOOP-15278 | log s3a at info | Major | fs/s3 | Steve Loughran | Steve Loughran
HDFS-13224 | RBF: Resolvers to support mount points across multiple subclusters | Major | . | Íñigo Goiri | Íñigo Goiri
HDFS-13215 | RBF: Move Router to its own module | Major | . | Íñigo Goiri | Wei Yan
YARN-8053 | Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages. | Major | . | Rohith Sharma K S | Rohith Sharma K S
HDFS-13250 | RBF: Router to manage requests across multiple subclusters | Major | . | Íñigo Goiri | Íñigo Goiri
HDFS-11190 | [READ] Namenode support for data stored in external stores. | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-10675 | [READ] Datanode support to read from external stores. | Major | . | Virajith Jalaparti | Virajith Jalaparti
HDFS-13318 | RBF: Fix FindBugs in hadoop-hdfs-rbf | Minor | . | Íñigo Goiri | Ekanth Sethuramalingam
HDFS-12792 | RBF: Test Router-based federation using HDFSContract | Major | . | Íñigo Goiri | Íñigo Goiri
YARN-7581 | HBase filters are not constructed correctly in ATSv2 | Major | ATSv2 | Haibo Chen | Haibo Chen
YARN-7986 | ATSv2 REST API queries do not return results for uppercase application tags | Critical | . | Charan Hebri | Charan Hebri
HDFS-12512 | RBF: Add WebHDFS | Major | fs | Íñigo Goiri | Wei Yan
YARN-8070 | Yarn Service API site doc broken due to unwanted character in YarnServiceAPI.md | Blocker | site | Gour Saha | Gour Saha
HDFS-13291 | RBF: Implement available space based OrderResolver | Major | . | Yiqun Lin | Yiqun Lin
HDFS-13204 | RBF: Optimize name service safe mode icon | Minor | . | liuhongtong | liuhongtong
HDFS-13352 | RBF: Add xsl stylesheet for hdfs-rbf-default.xml | Major | documentation | Takanobu Asanuma | Takanobu Asanuma
YARN-8010 | Add config in FederationRMFailoverProxy to not bypass facade cache when failing over | Minor | . | Botong Huang | Botong Huang
HDFS-13347 | RBF: Cache datanode reports | Minor | . | Íñigo Goiri | Íñigo Goiri
YARN-8069 | Clean up example hostnames | Major | . | Billie Rinaldi | Billie Rinaldi
HDFS-13364 | RBF: Support NamenodeProtocol in the Router | Major | . | Íñigo Goiri | Íñigo Goiri
HADOOP-14651 | Update okhttp version to 2.7.5 | Major | fs/adl | Ray Chiang | Ray Chiang
YARN-8027 | Setting hostname of docker container breaks for –net=host in docker 1.13 | Major | yarn | Jim Brennan | Jim Brennan
YARN-7810 | TestDockerContainerRuntime test failures due to UID lookup of a non-existent user | Major | . | Shane Kumpf | Shane Kumpf
HADOOP-15497 | TestTrash should use proper test path to avoid failing on Windows | Minor | . | Anbang Hu | Anbang Hu

### OTHER:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-12376 | Enable JournalNode Sync by default | Major | hdfs | Hanisha Koneru | Hanisha Koneru
YARN-6499 | Remove the doc about Schedulable#redistributeShare() | Trivial | fairscheduler | Yufei Gu | Chetna Chaudhari
YARN-7343 | Add a junit test for ContainerScheduler recovery | Minor | . | kartheek muthyala | Sampada Dehankar
YARN-6124 | Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues | Major | . | Wangda Tan | Zian Chen
HADOOP-15149 | CryptoOutputStream should implement StreamCapabilities | Major | fs | Mike Drob | Xiao Chen
YARN-7691 | Add Unit Tests for ContainersLauncher | Major | . | Sampada Dehankar | Sampada Dehankar
YARN-7468 | Provide means for container network policy control | Major | nodemanager | Clay B. | Xuan Gong
YARN-6486 | FairScheduler: Deprecate continuous scheduling | Major | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg
HADOOP-15177 | Update the release year to 2018 | Blocker | build | Akira Ajisaka | Bharat Viswanadham
HADOOP-15197 | Remove tomcat from the Hadoop-auth test bundle | Major | . | Xiao Chen | Xiao Chen
HADOOP-14325 | [Umbrella] Stabilise S3A Server Side Encryption | Major | documentation, fs/s3, test | Steve Loughran |
YARN-7918 | Fix TestAMRMClientPlacementConstraints | Critical | . | Botong Huang | Gergely Novák
HDFS-13052 | WebHDFS: Add support for snasphot diff | Major | . | Lokesh Jain | Lokesh Jain
HADOOP-14742 | Document multi-URI replication Inode for ViewFS | Major | documentation, viewfs | Chris Douglas | Gera Shegalov
HDFS-13141 | WebHDFS: Add support for getting snasphottable directory list | Major | webhdfs | Lokesh Jain | Lokesh Jain
YARN-8072 | RM log is getting flooded with MemoryPlacementConstraintManager info logs | Critical | . | Zian Chen | Zian Chen