Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 0.23.11 - 2014-06-25

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-7688 | When a servlet filter throws an exception in init(..), the Jetty server failed silently. | Major | . | Tsz Wo Nicholas Sze | Uma Maheswara Rao G
HDFS-4461 | DirectoryScanner: volume path prefix takes up memory for every block that is scanned | Minor | . | Colin P. McCabe | Colin P. McCabe
HDFS-5637 | try to refeatchToken while local read InvalidToken occurred | Major | hdfs-client, security | Liang Xie | Liang Xie
HADOOP-10164 | Allow UGI to login with a known Subject | Major | . | Robert Joseph Evans | Robert Joseph Evans
HADOOP-10454 | Provide FileContext version of har file system | Major | . | Kihwal Lee | Kihwal Lee
HDFS-6191 | Disable quota checks when replaying edit log. | Major | namenode | Kihwal Lee | Kihwal Lee

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-9230 | TestUniformSizeInputFormat fails intermittently | Major | test | Karthik Kambatla | Karthik Kambatla
YARN-500 | ResourceManager webapp is using next port if configured port is already in use | Major | resourcemanager | Nishan Shetty | Kenji Kikushima
YARN-853 | maximum-am-resource-percent doesn’t work after refreshQueues command | Major | capacityscheduler | Devaraj K | Devaraj K
MAPREDUCE-5454 | TestDFSIO fails intermittently on JDK7 | Major | test | Karthik Kambatla | Karthik Kambatla
YARN-1053 | Diagnostic message from ContainerExitEvent is ignored in ContainerImpl | Blocker | . | Omkar Vinit Joshi | Omkar Vinit Joshi
HADOOP-10129 | Distcp may succeed when it fails | Critical | tools/distcp | Daryn Sharp | Daryn Sharp
HADOOP-10081 | Client.setupIOStreams can leak socket resources on exception or error | Critical | ipc | Jason Lowe | Tsuyoshi Ozawa
MAPREDUCE-5623 | TestJobCleanup fails because of RejectedExecutionException and NPE. | Major | . | Tsuyoshi Ozawa | Jason Lowe
YARN-1145 | Potential file handle leak in aggregated logs web ui | Major | . | Rohith Sharma K S | Rohith Sharma K S
YARN-1180 | Update capacity scheduler docs to include types on the configs | Trivial | capacityscheduler | Thomas Graves | Chen He
MAPREDUCE-5689 | MRAppMaster does not preempt reducers when scheduled maps cannot be fulfilled | Critical | . | Lohit Vijayarenu | Lohit Vijayarenu
HADOOP-10146 | Workaround JDK7 Process fd close bug | Critical | util | Daryn Sharp | Daryn Sharp
YARN-1592 | CapacityScheduler tries to reserve more than a node’s total memory on branch-0.23 | Major | capacityscheduler | Thomas Graves | Thomas Graves
HADOOP-10110 | hadoop-auth has a build break due to missing dependency | Blocker | build | Chuan Liu | Chuan Liu
HDFS-5806 | balancer should set SoTimeout to avoid indefinite hangs | Major | balancer & mover | Nathan Roberts | Nathan Roberts
HDFS-5728 | [Diskfull] Block recovery will fail if the metafile does not have crc for all chunks of the block | Critical | datanode | Vinayakumar B | Vinayakumar B
HDFS-5881 | Fix skip() of the short-circuit local reader (legacy). | Critical | . | Kihwal Lee | Kihwal Lee
HADOOP-10112 | har file listing doesn’t work with wild card | Major | tools | Brandon Li | Brandon Li
MAPREDUCE-5744 | Job hangs because RMContainerAllocator$AssignedRequests.preemptReduce() violates the comparator contract | Blocker | . | Sangjin Lee | Gera Shegalov
MAPREDUCE-5746 | Job diagnostics can implicate wrong task for a failed job | Major | jobhistoryserver | Jason Lowe | Jason Lowe
MAPREDUCE-5757 | ConcurrentModificationException in JobControl.toList | Major | client | Jason Lowe | Jason Lowe
MAPREDUCE-5778 | JobSummary does not escape newlines in the job name | Major | jobhistoryserver | Jason Lowe | Akira Ajisaka
MAPREDUCE-5789 | Average Reduce time is incorrect on Job Overview page | Major | jobhistoryserver, webapps | Rushabh S Shah | Rushabh S Shah
HADOOP-10332 | HttpServer’s jetty audit log always logs 200 OK | Major | . | Daryn Sharp | Jonathan Eagles
YARN-1670 | aggregated log writer can write more log data then it says is the log length | Critical | . | Thomas Graves | Mit Desai
HDFS-6166 | revisit balancer so_timeout | Blocker | balancer & mover | Nathan Roberts | Nathan Roberts
HADOOP-8826 | Docs still refer to 0.20.205 as stable line | Minor | . | Robert Joseph Evans | Mit Desai
HDFS-4576 | Webhdfs authentication issues | Major | webhdfs | Daryn Sharp | Daryn Sharp
MAPREDUCE-3191 | docs for map output compression incorrectly reference SequenceFile | Trivial | . | Todd Lipcon | Chen He
YARN-1932 | Javascript injection on the job status page | Blocker | . | Mit Desai | Mit Desai
HADOOP-10588 | Workaround for jetty6 acceptor startup issue | Major | . | Kihwal Lee | Kihwal Lee
HDFS-6449 | Incorrect counting in ContentSummaryComputationContext in 0.23. | Critical | . | Kihwal Lee | Kihwal Lee
YARN-3829 | The History Tracking UI is broken for Tez application on ResourceManager WebUI | Critical | applications | Irina Easterling |

### SUB-TASKS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-10148 | backport hadoop-10107 to branch-0.23 | Minor | ipc | Chen He | Chen He
YARN-1575 | Public localizer crashes with “Localized unkown resource” | Critical | nodemanager | Jason Lowe | Jason Lowe