Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 0.11.0 - 2007-02-02

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-852 | want ant task for record definitions | Major | record | Doug Cutting | Milind Bhandarkar
HADOOP-908 | Hadoop Abacus, a package for performing simple counting/aggregation | Major | . | Runping Qi | Runping Qi
HADOOP-918 | Examples of Abacus using Python plugins | Major | . | Runping Qi | Runping Qi
HADOOP-732 | SequenceFile’s header should allow to store metadata in the form of key/value pairs | Major | io | Runping Qi | Runping Qi
HADOOP-884 | Create scripts to run Hadoop on Amazon EC2 | Major | scripts | Tom White | Tom White
HADOOP-961 | a cli tool to get the event logs from a job | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-967 | flip boolean to have rpc clients send a header | Major | ipc | Owen O’Malley | Owen O’Malley

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-842 | change the open method in ClientProtocol to take an additional argument: clientMachine | Major | . | Hairong Kuang | Hairong Kuang
HADOOP-890 | Update tag and metric names to conform to HADOOP-887 | Minor | metrics | Nigel Daley | Nigel Daley
HADOOP-801 | job tracker should keep a log of task completion and failure | Major | . | Owen O’Malley | Sanjay Dahiya
HADOOP-897 | Need a simpler way to specify arbitrary options to java compiler while building Hadoop | Minor | build | Milind Bhandarkar | Milind Bhandarkar
HADOOP-830 | Improve the performance of the Merge phase | Major | . | Devaraj Das | Devaraj Das
HADOOP-833 | need documentation of native build requirements | Major | documentation | Doug Cutting | Arun C Murthy
HADOOP-726 | HDFS locking mechanisms should be simplified or removed | Minor | . | Sameer Paranjpye | Raghu Angadi
HADOOP-659 | Boost the priority of re-replicating blocks that are far from their replication target | Major | . | Konstantin Shvachko | Hairong Kuang
HADOOP-936 | More updates to metric names to conform to HADOOP-887 | Minor | . | Nigel Daley |
HADOOP-602 | Remove Lucene dependency | Major | . | Andrzej Bialecki | Milind Bhandarkar
HADOOP-788 | Streaming should use a subclass of TextInputFormat for reading text inputs. | Major | . | Owen O’Malley | Sanjay Dahiya
HADOOP-963 | improve the stack trace returned by RPC client | Major | ipc | Owen O’Malley | Owen O’Malley
HADOOP-862 | Add handling of s3 to CopyFile tool | Minor | util | stack |
HADOOP-692 | Rack-aware Replica Placement | Major | . | Hairong Kuang | Hairong Kuang
HADOOP-805 | JobClient should print the Task’s stdout and stderr to the clients console | Major | . | Owen O’Malley | Sanjay Dahiya

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-781 | Remove from trunk things deprecated in 0.10 branch. | Major | . | Doug Cutting | Doug Cutting
HADOOP-757 | “Bad File Descriptor” in closing DFS file | Major | . | Owen O’Malley | Raghu Angadi
HADOOP-855 | HDFS should repair corrupted files | Major | . | Wendy Chien | Wendy Chien
HADOOP-886 | thousands of TimerThreads created by metrics API | Major | metrics | Nigel Daley | Nigel Daley
HADOOP-899 | Removal of deprecated code (in v0.10.0) from trunk breaks libhdfs | Major | . | Sameer Paranjpye | Sameer Paranjpye
HADOOP-898 | namenode generates infinite stream of null pointers | Major | . | Owen O’Malley | Raghu Angadi
HADOOP-905 | Code to qualify inputDirs doesn’t affect path validation | Major | fs | Kenji Matsuoka |
HADOOP-902 | NPE in DFSOutputStream.closeBackupStream() | Major | . | Raghu Angadi | Raghu Angadi
HADOOP-735 | The underlying data structure, ByteArrayOutputStream, for buffer type of Hadoop record is inappropriate | Major | record | Runping Qi | Milind Bhandarkar
HADOOP-916 | HADOOP-908 patch causes javadoc warnings | Trivial | . | Nigel Daley | Nigel Daley
HADOOP-901 | Make S3FileSystem do recursive renames | Major | fs | Tom White |
HADOOP-912 | TestMiniMRWithDFS fails sporadically | Major | . | Nigel Daley | Arun C Murthy
HADOOP-920 | MapFileOutputFormat and SequenceFileOutputFormat use incorrect key/value classes in map/reduce tasks | Major | . | Andrzej Bialecki | Andrzej Bialecki
HADOOP-758 | FileNotFound on DFS block file | Major | . | Owen O’Malley | Raghu Angadi
HADOOP-909 | dfs “du” shows that the size of a subdirectory is 0 | Major | . | Hairong Kuang | Hairong Kuang
HADOOP-731 | Sometimes when a dfs file is accessed and one copy has a checksum error the I/O command fails, even if another copy is alright. | Major | . | Dick King | Wendy Chien
HADOOP-929 | PhasedFileSystem should implement get/set configuration | Major | . | Sanjay Dahiya | Sanjay Dahiya
HADOOP-935 | Abacus should not delete the output dir | Major | . | Runping Qi | Runping Qi
HADOOP-856 | fsck reports a non-existant DFS path as healthy | Minor | . | Nigel Daley | Milind Bhandarkar
HADOOP-227 | Namespace check pointing is not performed until the namenode restarts. | Major | . | Konstantin Shvachko | dhruba borthakur
HADOOP-937 | data node re-registration | Major | . | Hairong Kuang | Hairong Kuang
HADOOP-922 | Optimize small reads and seeks | Major | . | dhruba borthakur | dhruba borthakur
HADOOP-959 | TestCheckpoint fails on Windows | Major | . | dhruba borthakur | dhruba borthakur
HADOOP-934 | TaskTracker sends duplicate status when updating task metrics throws exception | Major | . | Nigel Daley | Arun C Murthy
HADOOP-881 | job history web/ui does not count task failures correctly | Major | . | Owen O’Malley | Sanjay Dahiya
HADOOP-962 | Hadoop EC2 scripts are not executable | Major | scripts | Tom White | Tom White
HADOOP-549 | NullPointerException in TaskReport’s serialization code | Major | . | Michel Tourn | Owen O’Malley
HADOOP-405 | Duplicate browseDirectory.jsp | Minor | . | Konstantin Shvachko | navychen
HADOOP-964 | ClassNotFoundException in ReduceTaskRunner | Blocker | . | Dennis Kubes |
HADOOP-969 | deadlock in job tracker RetireJobs | Critical | . | Owen O’Malley | Owen O’Malley
HADOOP-965 | Isolation Runner looking for job.jar in wrong directory | Major | . | Dennis Kubes |
HADOOP-309 | NullPointerException in StatusHttpServer | Minor | . | Konstantin Shvachko | navychen