Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 0.3.0 - 2006-06-02

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-209 | Add a program to recursively copy directories across file systems | Major | fs | Milind Bhandarkar |
HADOOP-115 | permit reduce input types to differ from reduce output types | Major | . | Runping Qi | Runping Qi
HADOOP-233 | add a http status server for the task trackers | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-222 | Set replication from dfsshell | Trivial | . | Johan Oskarsson | Johan Oskarsson
HADOOP-256 | Implement a C api for hadoop dfs | Major | . | Arun C Murthy | Arun C Murthy

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-204 | Need to tweak a few things in the metrics package to support the Simon plugin | Major | metrics | David Bowen | David Bowen
HADOOP-208 | add failure page to webapp | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-202 | sort should use a smaller number of reduces | Trivial | . | Owen O’Malley | Owen O’Malley
HADOOP-212 | allow changes to dfs block size | Critical | . | Owen O’Malley | Owen O’Malley
HADOOP-218 | Inefficient calls to get configuration values in TaskInprogress | Minor | . | Mahadev konar | Mahadev konar
HADOOP-216 | Task Detail web page missing progress | Trivial | . | Bryan Pendleton | Doug Cutting
HADOOP-195 | improve performance of map output transfers | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-254 | use http to shuffle data between the maps and the reduces | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-75 | dfs should check full file availability only at close | Minor | . | Doug Cutting | Milind Bhandarkar
HADOOP-211 | logging improvements for Hadoop | Minor | . | Sameer Paranjpye | Sameer Paranjpye

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-146 | potential conflict in block id’s, leading to data corruption | Major | . | Yoram Arnon | Konstantin Shvachko
HADOOP-180 | task tracker times out cleaning big job | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-200 | The map task names are sent to the reduces | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-219 | SequenceFile#handleChecksumException NPE | Trivial | io | stack | Doug Cutting
HADOOP-179 | task tracker ghosts remain after 10 minutes | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-161 | dfs blocks define equal, but not hashcode | Major | . | Owen O’Malley | Milind Bhandarkar
HADOOP-228 | hadoop cp should have a -config option | Minor | fs | Yoram Arnon | Milind Bhandarkar
HADOOP-229 | hadoop cp should generate a better number of map tasks | Minor | fs | Yoram Arnon | Milind Bhandarkar
HADOOP-238 | map outputs transfers fail with EOFException | Blocker | . | Owen O’Malley | Owen O’Malley
HADOOP-205 | the job tracker does not schedule enough map on the cluster | Major | . | Owen O’Malley | Mahadev konar
HADOOP-247 | The Reduce Task thread for reporting progress during the sort exits in case of any IOException | Critical | . | Mahadev konar | Mahadev konar
HADOOP-241 | TestCopyFiles fails under cygwin due to incorrect path | Minor | fs | Konstantin Shvachko | Milind Bhandarkar
HADOOP-251 | progress report failures kill task | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-235 | LocalFileSystem.openRaw() throws the wrong string for FileNotFoundException | Major | . | Benjamin Reed |
HADOOP-163 | If a DFS datanode cannot write onto its file system. it should tell the name node not to assign new blocks to it. | Major | . | Runping Qi | Hairong Kuang
HADOOP-124 | don’t permit two datanodes to run from same dfs.data.dir | Critical | . | Bryan Pendleton | Konstantin Shvachko
HADOOP-259 | map output http client does not timeout | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-264 | WritableFactory has no permissions to create DatanodeRegistration | Blocker | . | Owen O’Malley | Owen O’Malley
HADOOP-265 | Abort tasktracker if it can not write to its local directories | Major | . | Hairong Kuang | Hairong Kuang
HADOOP-217 | IllegalAcessException when creating a Block object via WritableFactories | Major | . | Hairong Kuang | Hairong Kuang
HADOOP-270 | possible deadlock when shut down a datanode thread | Major | . | Hairong Kuang | Hairong Kuang
HADOOP-141 | Disk thrashing / task timeouts during map output copy phase | Major | . | p sutter | Owen O’Malley

### SUB-TASKS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-220 | Add -dfs and -jt command-line parameters to specify namenode and jobtracker. | Major | fs | Milind Bhandarkar | Milind Bhandarkar