Apache Hadoop

Configure Apache Hadoop Log Source with observIQ

Supported Versions

Apache Hadoop versions

  • 3.x
  • 2.x

Configuration

Option

Description

DataNode Logs

Use this field to verify the path to the Data Node log file and adjust default as needed (/usr/local/hadoop/logs/hadoop--datanode-.log).

ResourceManager Logs

Use this field to verify the path to the Resource Manager log file and adjust default as needed (/usr/local/hadoop/logs/hadoop--resourcemgr-.log).

NameNode Logs

Use this field to verify the path to the Name Node log file and adjust default as needed (/usr/local/hadoop/logs/hadoop--namenode-.log).

Start At

Choose whether to start reading from the beginning or end of a file with "end" being the default.

Log Types

Types

hadoop.datanode

hadoop.resourcemgr

hadoop.namenode

Dashboards

After creating or updating or an Apache Hadoop Source, the [oiq] Apache Hadoop - Overview Dashboard and accompanying visualizations will be installed to your account automatically.

Advanced

For more information on the advanced configuration capabilities, see our detailed plugin guide here.