安装jmxtrans
jmxtrans是一个通过jmx采集java应用的数据采集器,只要java应用开启了JMX端口,就可以进行采集
- 去github下载 https://github.com/jmxtrans/jmxtrans/downloads
- 源码下载编译
git clone https://github.com/jmxtrans/jmxtrans.git
mvn clean package -Dmaven.test.skip=true -DskipTests=true;
- rpm安装jmxtrans必须为root用户
wget https://github.com/downloads/jmxtrans/jmxtrans/jmxtrans-20121016.145842.6a28c97fbb-0.noarch.rpm
#查看是否已经安装jmxtrans
rpm -qa|grep jmx
#卸载
rmp -e jmxtrans-20121016.145842.6a28c97fbb-0.noarch.rpm
#安装jmxgrans
rpm -ivh jmxtrans-20121016.145842.6a28c97fbb-0.noarch.rpm
- 还有一种安装方式,就是将配置好的jmxtrans打包,复制到其他服务器上运行时只需解压启动就可以,哪个用户都行
输入所需的JVM堆大小:512(megs)是默认值。您需要监视的JVM越多,您可能需要的内存就越多。如果您收到OutOfMemoryError,则wrapper.java.memory通过编辑增加/etc/jmxtrans/wrapper.conf。
#这些只是默认目录,如果用jmxtrans.sh start启动的话,是不会默认这些目录的
#如果用/etc/init.d/jmxtrans start启动,却有意想不到的错误
#该应用程序安装在:
/usr/share/jmxtrans
#配置选项存储在:
/etc/sysconfig/jmxtrans
#有一个init脚本:
/etc/init.d/jmxtrans
#将.json文件放入:
/var/lib/jmxtrans
#去安装目录建立自己的json和log目录
cd /usr/share/jmxtrans
mkdir json
mkdir logs
- 配置
- jmxtrans.conf
cp /etc/sysconfig/jmxtrans /usr/share/jmxtrans/jmxtrans.conf
vim jmxtrans.conf
#jmxtrans-270-SNAPSHOT-all.jar是自己编译的最新源码包
export JAR_FILE="/usr/share/jmxtrans/jmxtrans-270-SNAPSHOT-all.jar"
export LOG_DIR="/usr/share/jmxtrans/logs"
export SECONDS_BETWEEN_RUNS=60
export JSON_DIR="/usr/share/jmxtrans/json"
#最大堆(m)
export HEAP_SIZE=512
#最大年轻代(m)
export NEW_SIZE=64
export CPU_CORES=16
#老年代和年轻代的比例
export NEW_RATIO=8
export LOG_LEVEL=debug
vim jmxtrans.sh
#CONF_FILE=${CONF_FILE:-"jmxtrans.conf"}
CONF_FILE=${CONF_FILE:-"/usr/share/jmxtrans/jmxtrans.conf"}
LOG_DIR=${LOG_DIR:-"/usr/share/jmxtrans/logs"}
#JAR_FILE=${JAR_FILE:-"jmxtrans-all.jar"}
JAR_FILE=${JAR_FILE:-"jmxtrans-270-SNAPSHOT-all.jar"}
#JSON_DIR=${JSON_DIR:-"."}
JSON_DIR=${JSON_DIR:-"/usr/share/jmxtrans/json"}
- 报错
[root@xxx server]# /etc/init.d/jmxtrans start
Starting jmxtrans: [ OK ]
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=384m; support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=384m; support was removed in 8.0
MaxTenuringThreshold of 16 is invalid; must be between 0 and 15
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.
- 解决
#JDK8 里Nimbus -XX:MaxTenuringThreshold 的最大值是15,默认配置里的是
cd /usr/share/jmxtrans
vim jmxtrans.sh
#-XX:MaxTenuringThreshold=16 改为:
-XX:MaxTenuringThreshold=15
com.googlecode.jmxtrans.util.LifecycleException: Error parsing json: ./test.json
at com.googlecode.jmxtrans.JmxTransformer.processFilesIntoServers(JmxTransformer.java:358)
at com.googlecode.jmxtrans.JmxTransformer.startupSystem(JmxTransformer.java:301)
at com.googlecode.jmxtrans.JmxTransformer.start(JmxTransformer.java:142)
at com.googlecode.jmxtrans.JmxTransformer.doMain(JmxTransformer.java:107)
at com.googlecode.jmxtrans.JmxTransformer.main(JmxTransformer.java:92)
Caused by: java.lang.IllegalArgumentException: Invalid type id 'com.googlecode.jmxtrans.model.output.InfluxDbWriterFactory' (for id type 'Id.class'): no such class found
at org.codehaus.jackson.map.jsontype.impl.ClassNameIdResolver.typeFromId(ClassNameIdResolver.java:89)
- 解决
是说找不到com.googlecode.jmxtrans.model.output.InfluxDbWriterFactory这个类,于是我去官网找到github地址下载了源码,发现有这个类,所以重新编译将jar包替换,去修改jmxtrans.sh
脚本,将项目所用jar包替换为重新编译生成的
#JAR_FILE=${JAR_FILE:-"jmxtrans-all.jar"}
JAR_FILE=${JAR_FILE:-"jmxtrans-270-SNAPSHOT-all.jar"}
- 启动
#必须root用户启动
./jmxtrans.sh start
启动后每次刚过00:00点的时候,jmxtrans就不工作了,因为过了00:00 jmxtrans.log就重新生成了一个,导致jmxtrans认为配置文件修改了,随即停止工作,解决方式就是将jmxtrans.sh脚本中的配置文件和log目录都分别指定到某个目录,不要用默认的当前目录,也不要放在同一个目录
报错
- 如果influxdb没有账号密码,那么账号密码用root填充,不然报下面的错
Caused by: com.fasterxml.jackson.databind.exc.InvalidDefinitionException: Cannot construct instance of `com.googlecode.jmxtrans.model.output.InfluxDbWriter
Factory`, problem: Expecting a non-empty string for username
...
Caused by: java.lang.IllegalArgumentException: Expecting a non-empty string for username
- 如果库名已经提前建立好,那么配置中还需要加一个参数
"createDatabase":"false"
,不然会报下面的错
org.influxdb.InfluxDBException: {"error":"invalid write endpoint"}
at org.influxdb.impl.InfluxDBImpl.execute(InfluxDBImpl.java:511)
at org.influxdb.impl.InfluxDBImpl.createDatabase(InfluxDBImpl.java:459)
at com.googlecode.jmxtrans.model.output.InfluxDbWriter.doWrite(InfluxDbWriter.java:165)
at com.googlecode.jmxtrans.model.output.support.ResultTransformerOutputWriter.doWrite(ResultTransformerOutputWriter.java:53)
- 查看github上的源码,可知这个
createDatabase
默认是true
InfluxDbWriterFactory.java
public InfluxDbWriterFactory(
@JsonProperty("typeNames") ImmutableList<String> typeNames,
@JsonProperty("booleanAsNumber") boolean booleanAsNumber,
@JsonProperty("url") String url,
@JsonProperty("username") String username,
@JsonProperty("password") String password,
@JsonProperty("database") String database,
@JsonProperty("tags") ImmutableMap<String, String> tags,
@JsonProperty("writeConsistency") String writeConsistency,
@JsonProperty("retentionPolicy") String retentionPolicy,
@JsonProperty("resultTags") List<String> resultTags,
@JsonProperty("createDatabase") Boolean createDatabase,
@JsonProperty("reportJmxPortAsTag") Boolean reportJmxPortAsTag,
@JsonProperty("typeNamesAsTags") Boolean typeNamesAsTags,
@JsonProperty("allowStringValues") Boolean allowStringValues) {
...
this.typeNames = firstNonNull(typeNames,ImmutableList.<String>of());
this.booleanAsNumber = booleanAsNumber;
this.database = database;
this.createDatabase = firstNonNull(createDatabase, TRUE);
...
InfluxDbWriter.java
@Override
public void doWrite(Server server, Query query, Iterable<Result> results) throws Exception {
// Creates only if it doesn't already exist
if (createDatabase) {
influxDB.createDatabase(database);
}