Hadoop

Use an HDFS filesystem checking to display Hadoop block locations.

Distribute data evenly across all disks on a Hadoop datanode.

Update reconfigurable properties on Hadoop node without restart.

Use JSON-based configuration format for Hadoop datanodes to create a whitelist and put these in normal, decommissioned or maintenance state.

Rebalance data across HDFS cluster.

Perform HDFS audit logging.

Create Yarn nodes whitelist.

Save namespace on namenode and perform checkpoint on secondary namenode.

Inspect Hadoop configuration using command-line.

Mount HDFS as a local file system.

Create Hadoop data nodes whitelist.

The Hadoop cluster enters safe mode during the name node startup till the basic indicators are met and later in case of emergency, which means that the cluster enters read-only mode.

Decommission Yarn node with minimal impact on the running applications.

Decommission HDFS data node with minimal impact on the running applications.

Display Hadoop cluster report.

Hadoop has a native implementation for certain components, but sometimes it does not load automatically.

Update Hadoop heartbeat interval to mark data node as dead at the predefined period of time depending on your requirement.

Validate Hadoop configuration XML files.

Configure Hadoop topology mapping using TXT DNS records.

Let’s perform basic HDFS operations.

Create a basic Hadoop cluster to play with it.