Apache Hadoop 3.5.0 – Apache Hadoop Changelog

##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Fair Call Queue
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide
- Registry
- Async Profiler

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Running Applications in runC Containers
- Using CGroups
- Secure Containers
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Tencent COS
- Huaweicloud OBS
- VolcanoEngine TOS

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- HDFS Federation Balance
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking
- Dynamometer

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 2.0.4-alpha - 2013-04-25

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-9374 | Add tokens from -tokenCacheFile into UGI | Major | security | Daryn Sharp | Daryn Sharp
YARN-443 | allow OS scheduling priority of NM to be different than the containers it launches | Major | nodemanager | Thomas Graves | Thomas Graves
HADOOP-9379 | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-3685 | There are some bugs in implementation of MergeManager | Critical | mrv2 | anty.rao | anty
YARN-429 | capacity-scheduler config missing from yarn-test artifact | Blocker | resourcemanager | Siddharth Seth | Siddharth Seth
MAPREDUCE-5023 | History Server Web Services missing Job Counters | Critical | jobhistoryserver, webapps | Kendall Thrapp | Ravi Prakash
HDFS-4571 | WebHDFS should not set the service hostname on the server side | Major | webhdfs | Alejandro Abdelnur | Alejandro Abdelnur
HDFS-3344 | Unreliable corrupt blocks counting in TestProcessCorruptBlocks | Major | namenode | Tsz Wo Nicholas Sze | Kihwal Lee
HADOOP-9406 | hadoop-client leaks dependency on JDK tools jar | Major | build | Alejandro Abdelnur | Alejandro Abdelnur
HADOOP-9301 | hadoop client servlet/jsp/jetty/tomcat JARs creating conflicts in Oozie & HttpFS | Blocker | build | Roman Shaposhnik | Alejandro Abdelnur
HADOOP-9299 | kerberos name resolution is kicking in even when kerberos is not configured | Blocker | security | Roman Shaposhnik | Daryn Sharp
MAPREDUCE-5053 | java.lang.InternalError from decompression codec cause reducer to fail | Major | . | Robert Parker | Robert Parker
HADOOP-9399 | protoc maven plugin doesn’t work on mvn 3.0.2 | Minor | build | Todd Lipcon | Konstantin Boudnik
YARN-470 | Support a way to disable resource monitoring on the NodeManager | Major | nodemanager | Hitesh Shah | Siddharth Seth
MAPREDUCE-5006 | streaming tests failing | Major | contrib/streaming | Alejandro Abdelnur | Sandy Ryza
HDFS-4581 | DataNode#checkDiskError should not be called on network errors | Major | datanode | Rohit Kochar | Rohit Kochar
MAPREDUCE-4549 | Distributed cache conflicts breaks backwards compatability | Blocker | mrv2 | Robert Joseph Evans | Robert Joseph Evans
HADOOP-9444 | $var shell substitution in properties are not expanded in hadoop-policy.xml | Blocker | conf | Konstantin Boudnik | Roman Shaposhnik
HADOOP-9405 | TestGridmixSummary#testExecutionSummarizer is broken | Minor | test, tools | Andrew Wang | Andrew Wang
YARN-449 | HBase test failures when running against Hadoop 2 | Blocker | . | Siddharth Seth |
HDFS-4649 | Webhdfs cannot list large directories | Blocker | namenode, security, webhdfs | Daryn Sharp | Daryn Sharp
MAPREDUCE-5117 | With security enabled HS delegation token renewer fails | Blocker | security | Roman Shaposhnik | Siddharth Seth
MAPREDUCE-5088 | MR Client gets an renewer token exception while Oozie is submitting a job | Blocker | . | Roman Shaposhnik | Daryn Sharp
MAPREDUCE-5083 | MiniMRCluster should use a random component when creating an actual cluster | Major | mrv2 | Siddharth Seth | Siddharth Seth
HDFS-4646 | createNNProxyWithClientProtocol ignores configured timeout value | Minor | namenode | Jagane Sundar | Jagane Sundar
HADOOP-9467 | Metrics2 record filtering (.record.filter.include/exclude) does not filter by name | Major | metrics | Chris Nauroth | Chris Nauroth
HADOOP-9471 | hadoop-client wrongfully excludes jetty-util JAR, breaking webhdfs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur
MAPREDUCE-5094 | Disable mem monitoring by default in MiniMRYarnCluster | Major | . | Siddharth Seth | Siddharth Seth
HDFS-4576 | Webhdfs authentication issues | Major | webhdfs | Daryn Sharp | Daryn Sharp

### SUB-TASKS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-4560 | Webhdfs cannot use tokens obtained by another user | Major | webhdfs | Daryn Sharp | Daryn Sharp
HDFS-4566 | Webdhfs token cancelation should use authentication | Major | webhdfs | Daryn Sharp | Daryn Sharp
HDFS-4567 | Webhdfs does not need a token for token operations | Major | webhdfs | Daryn Sharp | Daryn Sharp
HDFS-4577 | Webhdfs operations should declare if authentication is required | Major | webhdfs | Daryn Sharp | Daryn Sharp
HDFS-4548 | Webhdfs doesn’t renegotiate SPNEGO token | Blocker | . | Daryn Sharp | Daryn Sharp