ganglia java开发,ganglia3.6.1+jmxtrans+strom-0.9.4集成

1、安装ganglia参考之前的一篇博客(以下示例使用ganglia组播方式，单播方式大家自己尝试)

2、安装jmxtrans

3、安装storm

4、修改storm配置文件storm..yaml###nimbus config

nimbus.childopts: "-verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=12345 -Xmx1024m"

###supervisor config

supervisor.childopts: "-verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=12346 -Xmx256m"

5、为jmxtrans增加两个json文件

分别获取nimbus和supervisor节点的jvm信息，以下文件仅列举了部分参数，如果有需要可以增加queries中的数据，以监控更多的参数，具体的MBean的参数，可以通过jconsole来查看

nimbus.json{

"servers": [

{

"host": "master",

"port": "12345",

"queries": [

{

"outputWriters": [

{

"@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",

"settings": {

"groupName": "nimbus",

"host": "239.2.11.71",

"port": "8649"

}

}

],

"obj": "java.lang:type=Memory",

"resultAlias": "nimbus.heap",

"attr": [

"ObjectPendingFinalizationCount"

]

},

{

"outputWriters": [

{

"@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",

"settings": {

"groupName": "nimbus",

"host": "239.2.11.71",

"port": "8649"

}

}

],

"obj": "java.lang:name=Copy,type=GarbageCollector",

"resultAlias": "nimbus.gc",

"attr": [

"CollectionCount",

"CollectionTime"

]

},

{

"outputWriters": [

{

"@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",

"settings": {

"groupName": "nimbus",

"host": "239.2.11.71",

"port": "8649"

}

}

],

"obj": "java.lang:name=Code Cache,type=MemoryPool",

"resultAlias": "nimbus.threads",

"attr": [

"CollectionUsageThreshold",

"CollectionUsageThresholdCount",

"UsageThreshold",

"UsageThresholdCount"

]

},

{

"outputWriters": [

{

"@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",

"settings": {

"groupName": "nimbus",

"host": "239.2.11.71",

"port": "8649"

}

}

],

"obj": "java.lang:type=Runtime",

"resultAlias": "nimbus.runtime",

"attr": [

"StartTime",

"Uptime"

]

}

],

"numQueryThreads": 2

}

]

}

supervisor.json{

"servers": [

{

"host": "node1",

"port": "12346",

"queries": [

{

"outputWriters": [

{

"@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",

"settings": {

"groupName": "supervisor",

"host": "239.2.11.71",

"port": "8649"

}

}

],

"obj": "java.lang:type=Memory",

"resultAlias": "supervisor.heap",

"attr": [

"ObjectPendingFinalizationCount"

]

},

{

"outputWriters": [

{

"@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",

"settings": {

"groupName": "supervisor",

"host": "239.2.11.71",

"port": "8649"

}

}

],

"obj": "java.lang:name=Copy,type=GarbageCollector",

"resultAlias": "supervisor.gc",

"attr": [

"CollectionCount",

"CollectionTime"

]

},

{

"outputWriters": [

{

"@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",

"settings": {

"groupName": "supervisor",

"host": "239.2.11.71",

"port": "8649"

}

}

],

"obj": "java.lang:name=Code Cache,type=MemoryPool",

"resultAlias": "supervisor.threads",

"attr": [

"CollectionUsageThreshold",

"CollectionUsageThresholdCount",

"UsageThreshold",

"UsageThresholdCount"

]

},

{

"outputWriters": [

{

"@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",

"settings": {

"groupName": "supervisor",

"host": "239.2.11.71",

"port": "8649"

}

}

],

"obj": "java.lang:type=Runtime",

"resultAlias": "supervisor.runtime",

"attr": [

"StartTime",

"Uptime"

]

}

],

"numQueryThreads": 2

}

]

}

两个json文件一定要注意host是主机名，如果写ip的话，在ganglia里同一个节点会有两个显示，看着有点别扭，大家都统一使用hostname就好.ganglia的gmnod和gmetad不需要重启，用自动收集。

说明：

修改json文件需要重新启动jmxtrans,查看jmxtrans日志/var/log/jmxtrans/jmxtrans.log.

service jmxtrans restart

下面来张ganglia的主界面，监控两个节点

上图显示不出来监控指标，就放下面来了，可以看到supervisor的监控数据已经收集到ganglia里了。

下图搞了master节点的页面，可以看到nimbus group的监控数据已经显示，node1节点的supervisor group懒得上图了，大家可以明白了，不明白的去面壁去