Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 0.8.0 - 2006-11-03

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-635 | hadoop dfs copy, move commands should accept multiple source files as arguments | Major | . | dhruba borthakur |
HADOOP-636 | MapFile constructor should accept Progressible | Major | io | Doug Cutting | Doug Cutting

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-583 | DFSClient should use debug level to log missing data-node. | Minor | . | Konstantin Shvachko | Konstantin Shvachko
HADOOP-498 | fsck should execute faster | Major | . | Yoram Arnon | Milind Bhandarkar
HADOOP-586 | Job Name should not ben empty, if its is not given bu user, Hadoop should use original Jar name as the job name. | Trivial | . | Sanjay Dahiya | Sanjay Dahiya
HADOOP-625 | add a little servlet to display the server’s thread call stacks | Minor | . | Owen O’Malley | Owen O’Malley
HADOOP-626 | NNBench example comments are incorrect and code contains cut-and-paste error | Trivial | . | Nigel Daley | Nigel Daley
HADOOP-578 | Failed tasks should not be put at the end of the job tracker’s queue | Major | . | Owen O’Malley | Sanjay Dahiya
HADOOP-660 | Format of junit output should be configurable | Minor | . | Nigel Daley | Nigel Daley
HADOOP-670 | Generic types for FSNamesystem | Major | . | Konstantin Shvachko | Konstantin Shvachko
HADOOP-647 | Map outputs can’t have a different type of compression from the reduce outputs | Major | . | Owen O’Malley | Owen O’Malley

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-477 | Streaming should execute Unix commands and scripts in well known languages without user specifying the path | Major | . | arkady borkovsky | dhruba borthakur
HADOOP-514 | namenode heartbeat interval should be configurable | Major | . | Wendy Chien | Milind Bhandarkar
HADOOP-588 | JobTracker History bug - kill() ed tasks are logged wrongly as finished. | Major | . | Sanjay Dahiya | Sanjay Dahiya
HADOOP-462 | DFSShell throws out arrayoutofbounds exceptions if the number of arguments is not right | Minor | . | Mahadev konar | dhruba borthakur
HADOOP-561 | one replica of a file should be written locally if possible | Major | . | Yoram Arnon | dhruba borthakur
HADOOP-610 | Task Tracker offerService does not adequately protect from exceptions | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-554 | hadoop dfs command line doesn’t exit with status code on error | Major | . | Marco Nicosia | dhruba borthakur
HADOOP-634 | Test files missing copyright headers | Trivial | . | Nigel Daley | Nigel Daley
HADOOP-627 | MiniMRCluster missing synchronization | Major | . | Nigel Daley | Nigel Daley
HADOOP-563 | DFS client should try to re-new lease if it gets a lease expiration exception when it adds a block to a file | Major | . | Runping Qi | dhruba borthakur
HADOOP-641 | Name-node should demand a block report from resurrected data-nodes. | Major | . | Konstantin Shvachko | Konstantin Shvachko
HADOOP-642 | Explicit timeout for ipc.Client | Major | . | Konstantin Shvachko | Konstantin Shvachko
HADOOP-638 | TaskTracker missing synchronization around tasks variable access | Major | . | Nigel Daley | Nigel Daley
HADOOP-624 | fix warning about pathSpec should start with ‘/’ or ‘*’ : mapOutput | Minor | . | Owen O’Malley | Owen O’Malley
HADOOP-658 | source headers must conform to new Apache guidelines | Major | . | Doug Cutting | Doug Cutting
HADOOP-482 | unit test hangs when a cluster is running on the same machine | Minor | . | Wendy Chien | Wendy Chien
HADOOP-90 | DFS is succeptible to data loss in case of name node failure | Major | . | Yoram Arnon | Konstantin Shvachko
HADOOP-651 | fsck does not handle arguments -blocks and -locations correctly | Major | . | Milind Bhandarkar | Milind Bhandarkar
HADOOP-553 | DataNode and NameNode main() should catch and report exceptions. | Major | . | Konstantin Shvachko | Raghu Angadi
HADOOP-399 | the javadoc currently generates lot of warnings about bad fields | Trivial | . | Owen O’Malley | Nigel Daley
HADOOP-599 | DFS Always Reports 0 Bytes Used | Minor | . | Albert Chern | Raghu Angadi
HADOOP-663 | ant test is failing | Major | . | Mahadev konar | Mahadev konar
HADOOP-664 | build doesn’t fail if libhdfs test(s) fail | Minor | . | Nigel Daley | Nigel Daley
HADOOP-633 | if the jobinit thread gets killed the jobtracker keeps running without doing anything. | Minor | . | Mahadev konar | Owen O’Malley
HADOOP-669 | Upgrade to trunk causes data loss. | Blocker | . | Milind Bhandarkar | Milind Bhandarkar
HADOOP-373 | Some calls to mkdirs do not check return value | Major | . | Wendy Chien | Wendy Chien
HADOOP-671 | Distributed cache creates unnecessary symlinks if asked for creating symlinks | Major | . | Mahadev konar | Mahadev konar
HADOOP-665 | hadoop -rmr does NOT process multiple arguments and does not complain | Minor | . | dhruba borthakur | dhruba borthakur
HADOOP-572 | Chain reaction in a big cluster caused by simultaneous failure of only a few data-nodes. | Major | . | Konstantin Shvachko | Sameer Paranjpye