jmxtrans介绍与安装

安装jmxtrans

jmxtrans是一个通过jmx采集java应用的数据采集器，只要java应用开启了JMX端口，就可以进行采集

1. 去github下载 https://github.com/jmxtrans/jmxtrans/downloads
2. 源码下载编译

git clone https://github.com/jmxtrans/jmxtrans.git
mvn clean package -Dmaven.test.skip=true -DskipTests=true;

• rpm安装jmxtrans必须为root用户

wget https://github.com/downloads/jmxtrans/jmxtrans/jmxtrans-20121016.145842.6a28c97fbb-0.noarch.rpm
#查看是否已经安装jmxtrans
rpm -qa|grep jmx
#卸载
rmp -e jmxtrans-20121016.145842.6a28c97fbb-0.noarch.rpm
#安装jmxgrans
rpm -ivh jmxtrans-20121016.145842.6a28c97fbb-0.noarch.rpm

• 还有一种安装方式,就是将配置好的jmxtrans打包,复制到其他服务器上运行时只需解压启动就可以,哪个用户都行

输入所需的JVM堆大小：512（megs）是默认值。您需要监视的JVM越多，您可能需要的内存就越多。如果您收到OutOfMemoryError，则wrapper.java.memory通过编辑增加/etc/jmxtrans/wrapper.conf。

#这些只是默认目录，如果用jmxtrans.sh start启动的话，是不会默认这些目录的
#如果用/etc/init.d/jmxtrans start启动，却有意想不到的错误
#该应用程序安装在： 
/usr/share/jmxtrans
#配置选项存储在： 
/etc/sysconfig/jmxtrans
#有一个init脚本： 
/etc/init.d/jmxtrans
#将.json文件放入： 
/var/lib/jmxtrans

#去安装目录建立自己的json和log目录
cd /usr/share/jmxtrans
mkdir json
mkdir logs

2. 配置

• jmxtrans.conf

cp /etc/sysconfig/jmxtrans /usr/share/jmxtrans/jmxtrans.conf
vim jmxtrans.conf
#jmxtrans-270-SNAPSHOT-all.jar是自己编译的最新源码包
export JAR_FILE="/usr/share/jmxtrans/jmxtrans-270-SNAPSHOT-all.jar"
export LOG_DIR="/usr/share/jmxtrans/logs"
export SECONDS_BETWEEN_RUNS=60
export JSON_DIR="/usr/share/jmxtrans/json"
#最大堆(m)
export HEAP_SIZE=512
#最大年轻代(m)
export NEW_SIZE=64
export CPU_CORES=16
#老年代和年轻代的比例
export NEW_RATIO=8
export LOG_LEVEL=debug

• jmxtrans.sh

vim jmxtrans.sh
#CONF_FILE=${CONF_FILE:-"jmxtrans.conf"}
CONF_FILE=${CONF_FILE:-"/usr/share/jmxtrans/jmxtrans.conf"}
LOG_DIR=${LOG_DIR:-"/usr/share/jmxtrans/logs"}
#JAR_FILE=${JAR_FILE:-"jmxtrans-all.jar"}
JAR_FILE=${JAR_FILE:-"jmxtrans-270-SNAPSHOT-all.jar"}
#JSON_DIR=${JSON_DIR:-"."}
JSON_DIR=${JSON_DIR:-"/usr/share/jmxtrans/json"}

3. 报错

[root@xxx server]# /etc/init.d/jmxtrans start
Starting jmxtrans:                                         [  OK  ]
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=384m; support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=384m; support was removed in 8.0
MaxTenuringThreshold of 16 is invalid; must be between 0 and 15
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.

• 解决

#JDK8 里Nimbus -XX:MaxTenuringThreshold 的最大值是15，默认配置里的是
cd /usr/share/jmxtrans
vim jmxtrans.sh
#-XX:MaxTenuringThreshold=16 改为：
-XX:MaxTenuringThreshold=15

com.googlecode.jmxtrans.util.LifecycleException: Error parsing json: ./test.json
        at com.googlecode.jmxtrans.JmxTransformer.processFilesIntoServers(JmxTransformer.java:358)
        at com.googlecode.jmxtrans.JmxTransformer.startupSystem(JmxTransformer.java:301)
        at com.googlecode.jmxtrans.JmxTransformer.start(JmxTransformer.java:142)
        at com.googlecode.jmxtrans.JmxTransformer.doMain(JmxTransformer.java:107)
        at com.googlecode.jmxtrans.JmxTransformer.main(JmxTransformer.java:92)
Caused by: java.lang.IllegalArgumentException: Invalid type id 'com.googlecode.jmxtrans.model.output.InfluxDbWriterFactory' (for id type 'Id.class'): no such class found
        at org.codehaus.jackson.map.jsontype.impl.ClassNameIdResolver.typeFromId(ClassNameIdResolver.java:89)

• 解决
  是说找不到com.googlecode.jmxtrans.model.output.InfluxDbWriterFactory这个类，于是我去官网找到github地址下载了源码，发现有这个类，所以重新编译将jar包替换，去修改jmxtrans.sh脚本,将项目所用jar包替换为重新编译生成的

#JAR_FILE=${JAR_FILE:-"jmxtrans-all.jar"}
JAR_FILE=${JAR_FILE:-"jmxtrans-270-SNAPSHOT-all.jar"}

4. 启动

#必须root用户启动
./jmxtrans.sh start

启动后每次刚过00:00点的时候，jmxtrans就不工作了，因为过了00：00 jmxtrans.log就重新生成了一个，导致jmxtrans认为配置文件修改了，随即停止工作，解决方式就是将jmxtrans.sh脚本中的配置文件和log目录都分别指定到某个目录，不要用默认的当前目录，也不要放在同一个目录

报错

1. 如果influxdb没有账号密码,那么账号密码用root填充,不然报下面的错

Caused by: com.fasterxml.jackson.databind.exc.InvalidDefinitionException: Cannot construct instance of `com.googlecode.jmxtrans.model.output.InfluxDbWriter
Factory`, problem: Expecting a non-empty string for username
...
Caused by: java.lang.IllegalArgumentException: Expecting a non-empty string for username

2. 如果库名已经提前建立好,那么配置中还需要加一个参数"createDatabase":"false",不然会报下面的错

org.influxdb.InfluxDBException: {"error":"invalid write endpoint"}
    at org.influxdb.impl.InfluxDBImpl.execute(InfluxDBImpl.java:511)
    at org.influxdb.impl.InfluxDBImpl.createDatabase(InfluxDBImpl.java:459)
    at com.googlecode.jmxtrans.model.output.InfluxDbWriter.doWrite(InfluxDbWriter.java:165)
    at com.googlecode.jmxtrans.model.output.support.ResultTransformerOutputWriter.doWrite(ResultTransformerOutputWriter.java:53)

• 查看github上的源码,可知这个createDatabase默认是true

InfluxDbWriterFactory.java
public InfluxDbWriterFactory(
	@JsonProperty("typeNames") ImmutableList<String> typeNames,
	@JsonProperty("booleanAsNumber") boolean booleanAsNumber,
	@JsonProperty("url") String url,
	@JsonProperty("username") String username,
	@JsonProperty("password") String password,
	@JsonProperty("database") String database,
	@JsonProperty("tags") ImmutableMap<String, String> tags,
	@JsonProperty("writeConsistency") String writeConsistency,
	@JsonProperty("retentionPolicy") String retentionPolicy,
	@JsonProperty("resultTags") List<String> resultTags,
	@JsonProperty("createDatabase") Boolean createDatabase,
	@JsonProperty("reportJmxPortAsTag") Boolean reportJmxPortAsTag,
	@JsonProperty("typeNamesAsTags") Boolean typeNamesAsTags,
	@JsonProperty("allowStringValues") Boolean allowStringValues) {

...
this.typeNames = firstNonNull(typeNames,ImmutableList.<String>of());
	this.booleanAsNumber = booleanAsNumber;
	this.database = database;
	this.createDatabase = firstNonNull(createDatabase, TRUE);
...

InfluxDbWriter.java
@Override
	public void doWrite(Server server, Query query, Iterable<Result> results) throws Exception {
		// Creates only if it doesn't already exist
		if (createDatabase) {
			influxDB.createDatabase(database);
		}