hadoop-metrics
hadoop-metrics is a wrapper for Hadoop Metrics API.
Installation
gem
gem install hadoop-metrics
Usage
Setup
Without jmx
method, getting metrics depends on /metrics API.
So if you use this library, then you should enable dumping each metrics via hadoop-metrics.properties.
# example
mapred.class=org.apache.hadoop.metrics.spi.NoEmitMetricsContext
mapred.period=30
JobTracker
require 'hadoop_metrics/job_tracker'
jt = HadoopMetrics::JobTracker.new('localhost', 50030)
puts JSON.pretty_generate(jt.fairscheduler_jobs)
TaskTracker
require 'hadoop_metrics/job_tracker'
tt = HadoopMetrics::TaskTracker.new('localhost', 50060)
puts JSON.pretty_generate(tt.shuffle_output)
NameNode
require 'hadoop_metrics/name_node'
nn = HadoopMetrics::NameNode.new('localhost', 50070)
puts JSON.pretty_generate(nn.dfs)
DataNode
require 'hadoop_metrics/data_node'
dn = HadoopMetrics::DataNode.new('localhost', 50075)
puts JSON.pretty_generate(dn.info)
Copyright
Author | Masahiro Nakagawa |
Copyright | Copyright (c) 2013- Masahiro Nakagawa |
License | MIT License |