Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 0.6.0 - 2006-09-08

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-456 | Checkpointing and logging of data node descriptors | Major | . | Konstantin Shvachko | Konstantin Shvachko
HADOOP-322 | Need a job control utility to submit and monitor a group of jobs which have DAG dependency | Major | . | Runping Qi | Runping Qi
HADOOP-497 | DataNodes and TaskTrackers should be able to report hostnames and ips relative to customizable network interfaces and nameservers | Minor | util | Lorenzo Thione | Lorenzo Thione
HADOOP-441 | SequenceFile should support ‘custom compressors’ | Major | io | Arun C Murthy | Arun C Murthy

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-450 | Remove the need for users to specify the types of the inputs | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-464 | Troubleshooting message for RunJar (bin/hadoop jar) | Major | util | Michel Tourn |
HADOOP-468 | Setting scheduling priority in hadoop-env.sh | Minor | . | Vetle Roeim |
HADOOP-54 | SequenceFile should compress blocks, not individual entries | Major | io | Doug Cutting | Arun C Murthy
HADOOP-486 | adding username to jobstatus | Minor | . | Mahadev konar | Mahadev konar
HADOOP-437 | support gzip input files | Major | . | Michel Tourn |
HADOOP-463 | variable expansion in Configuration | Major | conf | Michel Tourn |
HADOOP-488 | Change ToolBase.doMain() to return a status code | Major | . | Andrzej Bialecki |
HADOOP-499 | Avoid the use of Strings to improve the performance of hadoop streaming | Major | . | Hairong Kuang | Hairong Kuang
HADOOP-64 | DataNode should be capable of managing multiple volumes | Minor | . | Sameer Paranjpye | Milind Bhandarkar
HADOOP-312 | Connections should not be cached | Major | ipc | Devaraj Das | Devaraj Das
HADOOP-483 | Document libhdfs and fix some OS specific stuff in Makefile | Major | . | Arun C Murthy | Arun C Murthy
HADOOP-474 | support compressed text files as input and output | Major | . | Owen O’Malley | Owen O’Malley

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-427 | DatanodeInfo class should be used instead of DatanodeDescriptor in the jsp & related files | Major | . | Devaraj Das | Devaraj Das
HADOOP-426 | streaming unit tests failing on SunOS | Major | . | Doug Cutting | Michel Tourn
HADOOP-400 | the job tracker re-runs failed tasks on the same node | Major | . | Owen O’Malley | Owen O’Malley
HADOOP-324 | “IOException: No space left on device” is handled incorrectly | Major | . | Konstantin Shvachko | Wendy Chien
HADOOP-434 | Use Hadoop scripts to run smallJobsBenchmark to avoid classpath issues. | Major | . | Sanjay Dahiya | Sanjay Dahiya
HADOOP-453 | bug in Text.setCapacity( int len ) | Minor | . | Sami Siren |
HADOOP-455 | Text class should support the DEL character | Major | io | Hairong Kuang | Hairong Kuang
HADOOP-176 | comparators of integral writable types are not transitive for inequalities | Major | io | Dick King |
HADOOP-421 | replace String in hadoop record io with the new Text class | Major | record | Owen O’Malley | Milind Bhandarkar
HADOOP-469 | Portability of hadoop shell scripts for deployment | Major | . | Jean-Baptiste Quenot |
HADOOP-473 | TextInputFormat does not correctly handle all line endings | Major | . | Dennis Kubes |
HADOOP-281 | dfs.FSDirectory.mkdirs can create sub-directories of a file! | Major | . | Sameer Paranjpye | Wendy Chien
HADOOP-419 | libdfs doesn’t work with application threads | Major | . | Christian Kunz | Owen O’Malley
HADOOP-460 | Small jobs benchmark fails with current Hadoop due to UTF8 -> Text ClassCastException | Major | . | Sanjay Dahiya |
HADOOP-196 | Fix buggy uselessness of Configuration( Configuration other) constructor | Major | conf | alan wootton |
HADOOP-501 | toString(resources, sb) in Configuration.java throws a ClassCastException since resources can be loaded from an URL | Minor | . | Thomas Friol |
HADOOP-424 | mapreduce jobs fail when no split is returned via inputFormat.getSplits | Major | . | Frédéric Bertin |
HADOOP-507 | Runtime exception in org.apache.hadoop.io.WritableFactories.newInstance when trying to startup namenode/datanode | Major | util | Arun C Murthy | Owen O’Malley
HADOOP-320 | bin/hadoop dfs -mv does not mv source’s checksum file if source is a file | Major | . | Hairong Kuang | Hairong Kuang
HADOOP-286 | copyFromLocal throws LeaseExpiredException | Major | . | Runping Qi | Konstantin Shvachko
HADOOP-50 | dfs datanode should store blocks in multiple directories | Major | . | Doug Cutting | Milind Bhandarkar
HADOOP-458 | libhdfs corrupts memory | Major | . | Christian Kunz | Konstantin Shvachko
HADOOP-517 | readLine function of UTF8ByteArrayUtils does not handle end of line correctly | Major | . | Hairong Kuang | Hairong Kuang

### OTHER:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-408 | Unit tests take too long to run. | Minor | . | Doug Cutting |