Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 0.18.2 - 2008-11-03

### INCOMPATIBLE CHANGES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-4228 | dfs datanode metrics, bytes_read, bytes_written overflows due to incorrect type used. | Blocker | metrics | Eric Yang | Eric Yang

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-2421 | Release JDiff report of changes between different versions of Hadoop | Minor | documentation | Nigel Daley | Doug Cutting

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-4277 | Checksum verification is disabled for LocalFS | Blocker | . | Raghu Angadi | Raghu Angadi
HADOOP-4271 | Bug in FSInputChecker makes it possible to read from an invalid buffer | Blocker | fs | Ning Li | Ning Li
HADOOP-3614 | TestLeaseRecovery fails when run with assertions enabled. | Blocker | . | Konstantin Shvachko | Tsz Wo Nicholas Sze
HADOOP-4314 | TestReplication fails quite often | Blocker | test | Raghu Angadi | Raghu Angadi
HADOOP-4326 | ChecksumFileSystem does not override all create(…) methods | Blocker | fs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-4395 | Reloading FSImage and FSEditLog may erase user and group information | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-4351 | ArrayIndexOutOfBoundsException during fsck | Blocker | . | Brian Bockelman | Hairong Kuang
HADOOP-4407 | HADOOP-4395 should use a Java 1.5 API for 0.18 | Blocker | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-4292 | append() does not work for LocalFileSystem | Blocker | fs | Raghu Angadi | Hairong Kuang
HADOOP-3217 | [HOD] Be less agressive when querying job status from resource manager. | Blocker | contrib/hod | Hemanth Yamijala | Hemanth Yamijala
HADOOP-3786 | Changes in HOD documentation | Blocker | documentation | Suman Sehgal | Vinod Kumar Vavilapalli
HADOOP-4399 | fuse-dfs per FD context is not thread safe and can cause segfaults and corruptions | Blocker | . | Pete Wyckoff | Pete Wyckoff
HADOOP-4369 | Metric Averages are not averages | Blocker | metrics | Brian Bockelman | Brian Bockelman
HADOOP-4469 | ant jar file not being included in tar distribution | Blocker | build | Nigel Daley | Nigel Daley
HADOOP-3914 | checksumOk implementation in DFSClient can break applications | Blocker | . | Christian Kunz | Christian Kunz
HADOOP-4467 | SerializationFactory should use current context ClassLoader | Blocker | . | Chris K Wensel | Chris K Wensel
HADOOP-4517 | unstable dfs when running jobs on 0.18.1 | Blocker | . | Christian Kunz | Tsz Wo Nicholas Sze
HADOOP-4526 | fsck failing with NullPointerException (return value 0) | Major | . | Koji Noguchi | Hairong Kuang
HADOOP-4533 | HDFS client of hadoop 0.18.1 and HDFS server 0.18.2 (0.18 branch) not compatible | Blocker | . | Runping Qi | Hairong Kuang
HADOOP-4483 | getBlockArray in DatanodeDescriptor does not honor passed in maxblocks value | Critical | . | Ahad Rana | Ahad Rana
HADOOP-4340 | “hadoop jar” always returns exit code 0 (success) to the shell when jar throws a fatal exception | Major | . | David Litster | Arun C Murthy

### TESTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-4403 | TestLeaseRecovery.testBlockSynchronization failed on trunk | Blocker | test | Hemanth Yamijala | Tsz Wo Nicholas Sze