Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# “Apache Hadoop” Changelog

## Release 2.10.2 - 2022-05-31

### IMPORTANT ISSUES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-17338 | Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc | Major | fs/s3 | Yongjun Zhang | Yongjun Zhang

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-12077 | Provide a multi-URI replication Inode for ViewFs | Major | fs | Gera Shegalov | Gera Shegalov
HADOOP-13055 | Implement linkMergeSlash and linkFallback for ViewFileSystem | Major | fs, viewfs | Zhe Zhang | Manoj Govindassamy

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-13722 | Code cleanup – ViewFileSystem and InodeTree | Minor | viewfs | Manoj Govindassamy | Manoj Govindassamy
YARN-1151 | Ability to configure auxiliary services from HDFS-based JAR files | Major | nodemanager | john lilley | Xuan Gong
HADOOP-15584 | move httpcomponents version in pom.xml | Minor | build | Brandon Scheller | Brandon Scheller
HADOOP-16208 | Do Not Log InterruptedException in Client | Minor | common | David Mollitor | David Mollitor
HADOOP-16052 | Remove Subversion and Forrest from Dockerfile | Minor | build | Akira Ajisaka | Xieming Li
YARN-10036 | Install yarnpkg and upgrade nodejs in Dockerfile | Major | buid, yarn-ui-v2 | Akira Ajisaka | Akira Ajisaka
HADOOP-16811 | Use JUnit TemporaryFolder Rule in TestFileUtils | Minor | common, test | David Mollitor | David Mollitor
HADOOP-16054 | Update Dockerfile to use Bionic | Major | build, test | Akira Ajisaka | Akira Ajisaka
YARN-10451 | RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined. | Major | . | Eric Payne | Eric Payne
YARN-9667 | Container-executor.c duplicates messages to stdout | Major | nodemanager, yarn | Adam Antal | Peter Bacsko
MAPREDUCE-7301 | Expose Mini MR Cluster attribute for testing | Minor | test | Swaroopa Kadam | Swaroopa Kadam
HDFS-15567 | [SBN Read] HDFS should expose msync() API to allow downstream applications call it explicitly. | Major | ha, hdfs-client | Konstantin Shvachko | Konstantin Shvachko
YARN-10450 | Add cpu and memory utilization per node and cluster-wide metrics | Minor | yarn | Jim Brennan | Jim Brennan
HDFS-15652 | Make block size from NNThroughputBenchmark configurable | Minor | benchmarks | Hui Fei | Hui Fei
HDFS-15665 | Balancer logging improvement | Major | balancer & mover | Konstantin Shvachko | Konstantin Shvachko
HADOOP-17342 | Creating a token identifier should not do kerberos name resolution | Major | common | Jim Brennan | Jim Brennan
YARN-10479 | RMProxy should retry on SocketTimeout Exceptions | Major | yarn | Jim Brennan | Jim Brennan
HDFS-15623 | Respect configured values of rpc.engine | Major | hdfs | Hector Sandoval Chaverri | Hector Sandoval Chaverri
HDFS-15717 | Improve fsck logging | Major | logging, namenode | Ahmed Hussein | Ahmed Hussein
HDFS-15751 | Add documentation for msync() API to filesystem.md | Major | documentation | Konstantin Shvachko | Konstantin Shvachko
YARN-10562 | Follow up changes for YARN-9833 | Major | yarn | Jim Brennan | Jim Brennan
HADOOP-17478 | Improve the description of hadoop.http.authentication.signature.secret.file | Minor | documentation | Akira Ajisaka | Akira Ajisaka
HADOOP-17501 | Fix logging typo in ShutdownHookManager | Major | common | Konstantin Shvachko | Fengnan Li
HADOOP-17354 | Move Jenkinsfile outside of the root directory | Major | build | Akira Ajisaka | Akira Ajisaka
MAPREDUCE-7319 | Log list of mappers at trace level in ShuffleHandler audit log | Minor | yarn | Jim Brennan | Jim Brennan
YARN-10626 | Log resource allocation in NM log at container start time | Major | . | Eric Badger | Eric Badger
YARN-10613 | Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF | Minor | capacity scheduler, scheduler preemption | Eric Payne | Eric Payne
MAPREDUCE-7324 | ClientHSSecurityInfo class is in wrong META-INF file | Major | . | Eric Badger | Eric Badger
HADOOP-17546 | Update Description of hadoop-http-auth-signature-secret in HttpAuthentication.md | Minor | . | Ravuri Sushma sree | Ravuri Sushma sree
HADOOP-17570 | Apply YETUS-1102 to re-enable GitHub comments | Major | build | Akira Ajisaka | Akira Ajisaka
HADOOP-16870 | Use spotbugs-maven-plugin instead of findbugs-maven-plugin | Major | build | Akira Ajisaka | Akira Ajisaka
HDFS-15931 | Fix non-static inner classes for better memory management | Major | . | Viraj Jasani | Viraj Jasani
HADOOP-17680 | Allow ProtobufRpcEngine to be extensible | Major | common | Hector Sandoval Chaverri | Hector Sandoval Chaverri
HADOOP-17756 | Increase precommit job timeout from 20 hours to 24 hours. | Major | build | Takanobu Asanuma | Takanobu Asanuma
HDFS-15150 | Introduce read write lock to Datanode | Major | datanode | Stephen O’Donnell | Stephen O’Donnell
YARN-10834 | Intra-queue preemption: apps that don’t use defined custom resource won’t be preempted. | Major | . | Eric Payne | Eric Payne
HADOOP-17775 | Remove JavaScript package from Docker environment | Major | build | Masatake Iwasaki | Masatake Iwasaki
HADOOP-12665 | Document hadoop.security.token.service.use_ip | Major | documentation | Arpit Agarwal | Akira Ajisaka
YARN-10456 | RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry | Major | resourcemanager | Eric Payne | Eric Payne
YARN-10860 | Make max container per heartbeat configs refreshable | Major | . | Eric Badger | Eric Badger
HADOOP-17813 | Checkstyle - Allow line length: 100 | Major | . | Akira Ajisaka | Viraj Jasani
HADOOP-17819 | Add extensions to ProtobufRpcEngine RequestHeaderProto | Major | common | Hector Sandoval Chaverri | Hector Sandoval Chaverri
HADOOP-17897 | Allow nested blocks in switch case in checkstyle settings | Minor | build | Masatake Iwasaki | Masatake Iwasaki
HADOOP-17857 | Check real user ACLs in addition to proxied user ACLs | Major | . | Eric Payne | Eric Payne
HADOOP-17926 | Maven-eclipse-plugin is no longer needed since Eclipse can import Maven projects by itself. | Minor | documentation | Rintaro Ikeda | Rintaro Ikeda
YARN-10935 | AM Total Queue Limit goes below per-user AM Limit if parent is full. | Major | capacity scheduler, capacityscheduler | Eric Payne | Eric Payne
HDFS-16257 | [HDFS] [RBF] Guava cache performance issue in Router MountTableResolver | Major | . | Janus Chow | Janus Chow
YARN-1115 | Provide optional means for a scheduler to check real user ACLs | Major | capacity scheduler, scheduler | Eric Payne |
HDFS-16294 | Remove invalid DataNode#CONFIG_PROPERTY_SIMULATED | Major | datanode | JiangHua Zhu | JiangHua Zhu
HDFS-16301 | Improve BenchmarkThroughput#SIZE naming standardization | Minor | benchmarks, test | JiangHua Zhu | JiangHua Zhu
HADOOP-18035 | Skip unit test failures to run all the unit tests | Major | build | Akira Ajisaka | Akira Ajisaka
HADOOP-18040 | Use maven.test.failure.ignore instead of ignoreTestFailure | Major | build | Akira Ajisaka | Akira Ajisaka
YARN-8234 | Improve RM system metrics publisher’s performance by pushing events to timeline server in batch | Critical | resourcemanager, timelineserver | Hu Ziqian | Ashutosh Gupta
HADOOP-18093 | Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java | Trivial | . | Xing Lin | Xing Lin
HADOOP-18099 | Upgrade bundled Tomcat to 8.5.75 | Major | httpfs, kms | Akira Ajisaka | Ashutosh Gupta
HADOOP-18110 | ViewFileSystem: Add Support for Localized Trash Root | Major | common | Xing Lin | Xing Lin
HADOOP-18144 | getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path | Major | common | Xing Lin | Xing Lin
HADOOP-18136 | Verify FileUtils.unTar() handling of missing .tar files | Minor | test, util | Steve Loughran | Steve Loughran
HDFS-16529 | Remove unnecessary setObserverRead in TestConsistentReadsObserver | Trivial | test | wangzhaohui | wangzhaohui
HADOOP-18155 | Refactor tests in TestFileUtil | Trivial | common | Gautham Banasandra | Gautham Banasandra
HADOOP-18088 | Replace log4j 1.x with reload4j | Major | . | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-11125 | Backport YARN-6483 to branch-2.10 | Major | resourcemanager | Ashutosh Gupta | Ashutosh Gupta
HADOOP-18172 | Change scope of getRootFallbackLink for InodeTree to make them accessible from outside package | Minor | . | Xing Lin | Xing Lin

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-10650 | DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission | Minor | . | John Zhuge | John Zhuge
HADOOP-13965 | Groups should be consistent in using default group mapping class | Minor | security | Yiqun Lin | Yiqun Lin
YARN-6977 | Node information is not provided for non am containers in RM logs | Major | capacity scheduler | Sumana Sathish | Suma Shivaprasad
HADOOP-15261 | Upgrade commons-io from 2.4 to 2.5 | Major | minikdc | PandaMonkey | PandaMonkey
HADOOP-15331 | Fix a race condition causing parsing error of java.io.BufferedInputStream in class org.apache.hadoop.conf.Configuration | Major | common | Miklos Szegedi | Miklos Szegedi
YARN-8222 | Fix potential NPE when gets RMApp from RM context | Critical | . | Tao Yang | Tao Yang
HDFS-13174 | hdfs mover -p /path times out after 20 min | Major | balancer & mover | István Fajth | István Fajth
HDFS-13723 | Occasional “Should be different group” error in TestRefreshUserMappings#testGroupMappingRefresh | Major | security, test | Siyao Meng | Siyao Meng
YARN-7266 | Timeline Server event handler threads locked | Major | ATSv2, timelineserver | Venkata Puneet Ravuri | Prabhu Joseph
HDFS-13677 | Dynamic refresh Disk configuration results in overwriting VolumeMap | Blocker | . | ZanderXu | ZanderXu
HADOOP-16334 | Fix yetus-wrapper not working when HADOOP_YETUS_VERSION >= 0.9.0 | Major | yetus | Wanqiang Ji | Wanqiang Ji
YARN-9594 | Fix missing break statement in ContainerScheduler#handle | Major | . | lujie | lujie
YARN-9744 | RollingLevelDBTimelineStore.getEntityByTime fails with NPE | Major | timelineserver | Prabhu Joseph | Prabhu Joseph
YARN-9785 | Fix DominantResourceCalculator when one resource is zero | Blocker | . | Bilwa S T | Bilwa S T
YARN-9833 | Race condition when DirectoryCollection.checkDirs() runs during container launch | Major | . | Peter Bacsko | Peter Bacsko
HDFS-14216 | NullPointerException happens in NamenodeWebHdfs | Critical | . | lujie | lujie
YARN-9984 | FSPreemptionThread can cause NullPointerException while app is unregistered with containers running on a node | Major | fairscheduler | Wilfred Spiegelenburg | Wilfred Spiegelenburg
HADOOP-16841 | The description of hadoop.http.authentication.signature.secret.file contains outdated information | Minor | documentation | Akira Ajisaka | Xieming Li
HADOOP-16768 | SnappyCompressor test cases wrongly assume that the compressed data is always smaller than the input data | Major | io, test | zhao bo | Akira Ajisaka
HADOOP-17068 | client fails forever when namenode ipaddr changed | Major | hdfs-client | Sean Chow | Sean Chow
HADOOP-17116 | Skip Retry INFO logging on first failover from a proxy | Major | ha | Hanisha Koneru | Hanisha Koneru
MAPREDUCE-7294 | Only application master should upload resource to Yarn Shared Cache | Major | mrv2 | zhenzhao wang | zhenzhao wang
YARN-10438 | Handle null containerId in ClientRMService#getContainerReport() | Major | resourcemanager | Raghvendra Singh | Shubham Gupta
MAPREDUCE-7289 | Fix wrong comment in LongLong.java | Trivial | documentation, examples | Akira Ajisaka | Wanqiang Ji
YARN-10393 | MR job live lock caused by completed state container leak in heartbeat between node manager and RM | Major | nodemanager, yarn | zhenzhao wang | Jim Brennan
YARN-10455 | TestNMProxy.testNMProxyRPCRetry is not consistent | Major | . | Ahmed Hussein | Ahmed Hussein
HADOOP-17223 | update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13 | Blocker | . | Pranav Bheda | Pranav Bheda
HADOOP-17309 | Javadoc warnings and errors are ignored in the precommit jobs | Major | build, documentation | Akira Ajisaka | Akira Ajisaka
MAPREDUCE-7302 | Upgrading to JUnit 4.13 causes testcase TestFetcher.testCorruptedIFile() to fail | Major | test | Peter Bacsko | Peter Bacsko
HDFS-15644 | Failed volumes can cause DNs to stop block reporting | Major | block placement, datanode | Ahmed Hussein | Ahmed Hussein
YARN-10467 | ContainerIdPBImpl objects can be leaked in RMNodeImpl.completedContainers | Major | resourcemanager | Haibo Chen | Haibo Chen
HADOOP-17340 | TestLdapGroupsMapping failing -string mismatch in exception validation | Major | test | Steve Loughran | Steve Loughran
HADOOP-17352 | Update PATCH_NAMING_RULE in the personality file | Minor | build | Akira Ajisaka | Akira Ajisaka
HADOOP-17358 | Improve excessive reloading of Configurations | Major | conf | Ahmed Hussein | Ahmed Hussein
YARN-8558 | NM recovery level db not cleaned up properly on container finish | Critical | . | Bibin Chundatt | Bibin Chundatt
YARN-10498 | Fix Yarn CapacityScheduler Markdown document | Trivial | documentation | zhaoshengjie | zhaoshengjie
HDFS-15660 | StorageTypeProto is not compatiable between 3.x and 2.6 | Major | . | Ryan Wu | Ryan Wu
HDFS-15725 | Lease Recovery never completes for a committed block which the DNs never finalize | Major | namenode | Stephen O’Donnell | Stephen O’Donnell
HADOOP-17438 | Increase docker memory limit in Jenkins | Major | build, scripts, test, yetus | Ahmed Hussein | Ahmed Hussein
HADOOP-16947 | Stale record should be remove when MutableRollingAverages generating aggregate data. | Major | . | Haibin Huang | Haibin Huang
HDFS-15632 | AbstractContractDeleteTest should set recursive parameter to true for recursive test cases. | Major | . | Konstantin Shvachko | Anton Kutuzov
HDFS-10498 | Intermittent test failure org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength.testSnapshotfileLength | Major | hdfs, snapshots | Hanisha Koneru | Jim Brennan
HADOOP-17495 | Backport HADOOP-16947 “Stale record should be remove when MutableRollingAverages generating aggregate data.” to branch 2.10 | Major | . | Felix N | Felix N
HDFS-15801 | Backport HDFS-14582 to branch-2.10 (Failed to start DN with ArithmeticException when NULL checksum used) | Major | . | Janus Chow | Janus Chow
YARN-10428 | Zombie applications in the YARN queue using FAIR + sizebasedweight | Critical | capacityscheduler | Guang Yang | Andras Gyori
HDFS-15792 | ClasscastException while loading FSImage | Major | nn | Renukaprasad C | Renukaprasad C
HADOOP-17516 | Upgrade ant to 1.10.9 | Major | . | Akira Ajisaka | Akira Ajisaka
YARN-10500 | TestDelegationTokenRenewer fails intermittently | Major | test | Akira Ajisaka | Masatake Iwasaki
MAPREDUCE-7323 | Remove job_history_summary.py | Major | . | Akira Ajisaka | Akira Ajisaka
HADOOP-17510 | Hadoop prints sensitive Cookie information. | Major | . | Renukaprasad C | Renukaprasad C
HDFS-15422 | Reported IBR is partially replaced with stored info when queuing. | Critical | namenode | Kihwal Lee | Stephen O’Donnell
YARN-10651 | CapacityScheduler crashed with NPE in AbstractYarnScheduler.updateNodeResource() | Major | . | Haibo Chen | Haibo Chen
MAPREDUCE-7320 | ClusterMapReduceTestCase does not clean directories | Major | . | Ahmed Hussein | Ahmed Hussein
HDFS-15849 | ExpiredHeartbeats metric should be of Type.COUNTER | Major | metrics | Konstantin Shvachko | Qi Zhu
HADOOP-17557 | skip-dir option is not processed by Yetus | Major | build, precommit, yetus | Ahmed Hussein | Ahmed Hussein
HADOOP-17572 | [branch-2.10] Docker image build fails due to the removal of openjdk-7-jdk package | Blocker | build | Akira Ajisaka | Akira Ajisaka
HADOOP-17582 | Replace GitHub App Token with GitHub OAuth token | Major | build | Akira Ajisaka | Akira Ajisaka
HADOOP-17586 | Upgrade org.codehaus.woodstox:stax2-api to 4.2.1 | Major | . | Ayush Saxena | Ayush Saxena
YARN-10588 | Percentage of queue and cluster is zero in WebUI | Major | . | Bilwa S T | Bilwa S T
MAPREDUCE-7322 | revisiting TestMRIntermediateDataEncryption | Major | job submission, security, test | Ahmed Hussein | Ahmed Hussein
HADOOP-17592 | Fix the wrong CIDR range example in Proxy User documentation | Minor | documentation | Kwangsun Noh | Kwangsun Noh
MAPREDUCE-7325 | Intermediate data encryption is broken in LocalJobRunner | Major | job submission, security | Ahmed Hussein | Ahmed Hussein
YARN-10697 | Resources are displayed in bytes in UI for schedulers other than capacity | Major | . | Bilwa S T | Bilwa S T
HADOOP-17602 | Upgrade JUnit to 4.13.1 | Major | build, security, test | Ahmed Hussein | Ahmed Hussein
MAPREDUCE-7332 | Fix SpillCallBackPathsFinder to use JDK7 on branch-2.10 | Minor | job submission, security | Ahmed Hussein | Ahmed Hussein
YARN-10501 | Can’t remove all node labels after add node label without nodemanager port | Critical | yarn | caozhiqiang | caozhiqiang
YARN-10716 | Fix typo in ContainerRuntime | Trivial | documentation | Wanqiang Ji | xishuhai
HADOOP-17603 | Upgrade tomcat-embed-core to 7.0.108 | Major | build, security | Ahmed Hussein | Ahmed Hussein
HADOOP-17601 | Upgrade Jackson databind in branch-2.10 to 2.9.10.7 | Major | . | Ahmed Hussein | Ahmed Hussein
YARN-10733 | TimelineService Hbase tests are failing with timeout error on branch-2.10 | Major | test, timelineserver, yarn | Ahmed Hussein | Ahmed Hussein
HDFS-15963 | Unreleased volume references cause an infinite loop | Critical | datanode | Shuyan Zhang | Shuyan Zhang
YARN-10460 | Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail | Major | nodemanager, test | Peter Bacsko | Peter Bacsko
YARN-10749 | Can’t remove all node labels after add node label without nodemanager port, broken by YARN-10647 | Major | . | D M Murali Krishna Reddy | D M Murali Krishna Reddy
YARN-10555 | Missing access check before getAppAttempts | Critical | webapp | lujie | lujie
HADOOP-17718 | Explicitly set locale in the Dockerfile | Blocker | build | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-10770 | container-executor permission is wrong in SecureContainer.md | Major | documentation | Akira Ajisaka | Siddharth Ahuja
HDFS-15915 | Race condition with async edits logging due to updating txId outside of the namesystem log | Major | hdfs, namenode | Konstantin Shvachko | Konstantin Shvachko
HDFS-16040 | RpcQueueTime metric counts requeued calls as unique events. | Major | hdfs | Simbarashe Dzinamarira | Simbarashe Dzinamarira
HDFS-16068 | WebHdfsFileSystem has a possible connection leak in connection with HttpFS | Major | . | Takanobu Asanuma | Takanobu Asanuma
HDFS-15618 | Improve datanode shutdown latency | Major | datanode | Ahmed Hussein | Ahmed Hussein
HADOOP-17769 | Upgrade JUnit to 4.13.2 | Major | . | Ahmed Hussein | Ahmed Hussein
YARN-10824 | Title not set for JHS and NM webpages | Major | . | Rajshree Mishra | Bilwa S T
MAPREDUCE-7353 | Mapreduce job fails when NM is stopped | Major | . | Bilwa S T | Bilwa S T
HADOOP-17793 | Better token validation | Major | . | Artem Smotrakov | Artem Smotrakov
HDFS-16042 | DatanodeAdminMonitor scan should be delay based | Major | datanode | Ahmed Hussein | Ahmed Hussein
HADOOP-17028 | ViewFS should initialize target filesystems lazily | Major | client-mounts, fs, viewfs | Uma Maheswara Rao G | Abhishek Das
HADOOP-17370 | Upgrade commons-compress to 1.21 | Major | common | Dongjoon Hyun | Akira Ajisaka
HADOOP-17886 | Upgrade ant to 1.10.11 | Major | . | Ahmed Hussein | Ahmed Hussein
HADOOP-17885 | Upgrade JSON smart to 1.3.3 on branch-2.10 | Major | . | Ahmed Hussein | Ahmed Hussein
HDFS-16207 | Remove NN logs stack trace for non-existent xattr query | Major | namenode | Ahmed Hussein | Ahmed Hussein
HDFS-16198 | Short circuit read leaks Slot objects when InvalidToken exception is thrown | Major | . | Eungsop Yoo | Eungsop Yoo
HDFS-16233 | Do not use exception handler to implement copy-on-write for EnumCounters | Major | namenode | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-16181 | [SBN Read] Fix metric of RpcRequestCacheMissAmount can’t display when tailEditLog form JN | Critical | . | wangzhaohui | wangzhaohui
YARN-8127 | Resource leak when async scheduling is enabled | Critical | . | Weiwei Yang | Tao Yang
HADOOP-17964 | Increase Java heap size for running Maven in Dockerfile of branch-2.10 | Major | build | Masatake Iwasaki | Masatake Iwasaki
HADOOP-16532 | Fix TestViewFsTrash to use the correct homeDir. | Minor | test, viewfs | Steve Loughran | Xing Lin
HADOOP-17965 | Fix documentation build failure using JDK 7 on branch-2.10 | Major | build | Masatake Iwasaki | Masatake Iwasaki
HDFS-7612 | TestOfflineEditsViewer.testStored() uses incorrect default value for cacheDir | Major | test | Konstantin Shvachko | Michael Kuchenbecker
HADOOP-17978 | Exclude ASF license check for pkg-resolver JSON | Major | build | Gautham Banasandra | Gautham Banasandra
HADOOP-17880 | Build Hadoop on Centos 7 | Major | build | baizhendong |
HADOOP-17988 | Disable JIRA plugin for YETUS on Hadoop | Critical | build | Gautham Banasandra | Gautham Banasandra
HDFS-16311 | Metric metadataOperationRate calculation error in DataNodeVolumeMetrics | Major | . | Tao Li | Tao Li
HADOOP-17999 | No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem | Major | . | Abhishek Das | Abhishek Das
YARN-9063 | ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing | Major | timelineserver, timelineservice | Tarun Parimi | Ashutosh Gupta
HADOOP-18049 | Pin python lazy-object-proxy to 1.6.0 in Docker file as newer versions are incompatible with python2.7 | Major | build | Dhananjay Badaya | Dhananjay Badaya
HADOOP-13500 | Synchronizing iteration of Configuration properties object | Major | conf | Jason Darrell Lowe | Dhananjay Badaya
YARN-10178 | Global Scheduler async thread crash caused by ’Comparison method violates its general contract | Major | capacity scheduler | tuyu | Andras Gyori
HDFS-16410 | Insecure Xml parsing in OfflineEditsXmlLoader | Minor | . | Ashutosh Gupta | Ashutosh Gupta
HADOOP-18158 | Fix failure of create-release script due to releasedocmaker changes in branch-2.10 | Major | build | Masatake Iwasaki | Masatake Iwasaki
HADOOP-18129 | Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem | Major | . | Abhishek Das | Abhishek Das
HDFS-16517 | In 2.10 the distance metric is wrong for non-DN machines | Major | . | Owen O’Malley | Owen O’Malley
HDFS-16518 | KeyProviderCache close cached KeyProvider with Hadoop ShutdownHookManager | Major | hdfs | Lei Yang | Lei Yang
HADOOP-18169 | getDelegationTokens in ViewFs should also fetch the token from the fallback FS | Major | . | Xing Lin | Xing Lin
YARN-10720 | YARN WebAppProxyServlet should support connection timeout to prevent proxy server from hanging | Critical | . | Qi Zhu | Qi Zhu
HDFS-11041 | Unable to unregister FsDatasetState MBean if DataNode is shutdown twice | Trivial | datanode | Wei-Chiu Chuang | Wei-Chiu Chuang
MAPREDUCE-7246 | In MapredAppMasterRest#Mapreduce_Application_Master_Info_API, the datatype of appId should be “string”. | Major | documentation | jenny | Ashutosh Gupta
YARN-11126 | ZKConfigurationStore Java deserialisation vulnerability | Major | yarn | Tamas Domok | Tamas Domok
YARN-11162 | Set the zk acl for nodes created by ZKConfigurationStore. | Major | resourcemanager | Owen O’Malley | Owen O’Malley

### TESTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-7011 | TestClientDistributedCacheManager::testDetermineCacheVisibilities assumes all parent dirs set other exec | Trivial | . | Christopher Douglas | Christopher Douglas

### SUB-TASKS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-15133 | [JDK9] Ignore com.sun.javadoc.* and com.sun.tools.* in animal-sniffer-maven-plugin to compile with Java 9 | Major | . | Akira Ajisaka | Akira Ajisaka
HADOOP-15293 | TestLogLevel fails on Java 9 | Major | test | Akira Ajisaka | Takanobu Asanuma
HADOOP-15513 | Add additional test cases to cover some corner cases for FileUtil#symlink | Major | . | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola
HADOOP-15783 | [JDK10] TestSFTPFileSystem.testGetModifyTime fails | Major | . | Akira Ajisaka | Akira Ajisaka
HADOOP-16764 | Rewrite Python example codes using Python3 | Minor | documentation | Kengo Seki | Kengo Seki
HADOOP-16767 | S3AInputStream reopening does not handle non IO exceptions properly | Major | . | Sergei Poganshev | Sergei Poganshev
HADOOP-17336 | Backport HADOOP-16005-“NativeAzureFileSystem does not support setXAttr” and HADOOP-16785. “Improve wasb and abfs resilience on double close() calls. followup to abfs close() fix.” to branch-2.10 | Major | fs/azure | Sally Zuo | Sally Zuo
HDFS-15716 | TestUpgradeDomainBlockPlacementPolicy flaky | Major | namenode, test | Ahmed Hussein | Ahmed Hussein
HADOOP-16748 | Migrate to Python 3 and upgrade Yetus to 0.13.0 | Major | . | Akira Ajisaka | Akira Ajisaka
HDFS-13975 | TestBalancer#testMaxIterationTime fails sporadically | Major | . | Jason Darrell Lowe | Toshihiko Uchida
HDFS-16072 | TestBlockRecovery fails consistently on Branch-2.10 | Major | datanode, test | Ahmed Hussein | Ahmed Hussein
HDFS-15659 | Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster | Major | test | Akira Ajisaka | Ahmed Hussein
HADOOP-17952 | Replace Guava VisibleForTesting by Hadoop’s own annotation in hadoop-common-project modules | Major | . | Viraj Jasani | Viraj Jasani
YARN-8546 | Resource leak caused by a reserved container being released more than once under async scheduling | Major | capacity scheduler | Weiwei Yang | Tao Yang
HDFS-13248 | RBF: Namenode need to choose block location for the client | Major | . | Wu Weiwei | Owen O’Malley

### OTHER:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-15808 | Add metrics for FSNamesystem read/write lock hold long time | Major | hdfs | Tao Li | Tao Li
HDFS-16298 | Improve error msg for BlockMissingException | Minor | . | Tao Li | Tao Li
HDFS-16312 | Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents | Minor | . | Tao Li | Tao Li
YARN-10540 | Node page is broken in YARN UI1 and UI2 including RMWebService api for nodes | Critical | webapp | Sunil G | Jim Brennan
HADOOP-17445 | Update the year to 2021 | Major | . | Xiaoqiao He | Xiaoqiao He
HADOOP-17571 | Upgrade com.fasterxml.woodstox:woodstox-core for security reasons | Major | . | Viraj Jasani | Viraj Jasani
HDFS-15895 | DFSAdmin#printOpenFiles has redundant String#format usage | Minor | . | Viraj Jasani | Viraj Jasani
HADOOP-18061 | Update the year to 2022 | Major | . | Ayush Saxena | Ayush Saxena
HADOOP-18191 | Log retry count while handling exceptions in RetryInvocationHandler | Minor | . | Viraj Jasani | Viraj Jasani
HADOOP-18125 | Utility to identify git commit / Jira fixVersion discrepancies for RC preparation | Major | . | Viraj Jasani | Viraj Jasani
HDFS-16551 | Backport HADOOP-17588 to 3.3 and other active old branches. | Major | . | Renukaprasad C | Renukaprasad C