大数据性能测试工具Dew --转载自李智慧

网址：https://github.com/zhihuili/Dew

 

#Dew# Big Data Cloud Management Plateform

##Quick Start##

###Start dew cluster###

• Build -- mvn clean install -Dhadoop-version=your_deployed_hadoop_version -DskipTests

• Set conf/slaves include your cluster's all nodes

• Set conf/dew.conf

• Start dew cluster -- sbin/start-all.sh

###Execute dew app###

• app.sparkpowermeter execute spark performance analysis
• app.webcenter start dew web console

 

app.sparkpowermeter

A tool which analyze spark application performance base on spark data flow.

Quick Start

Prerequisites: please check your cluster and confirm dstat is installed.

Deploy and run Dew in cluster.

Rename conf.properties.template to conf.properties then reset it.

Run SparkPowerMeter.

./analyze.sh [spark driver log file path]

(How to get spark driver log? eg. ./run.sh > driver.log 2>&1)

OR

./analyze.sh startTime(yy/MM/dd HH:mm:ss) endTime(yy/MM/dd HH:mm:ss)

(Just analyze the cluster performance during the time without data flow model.) For example: ./analyze.sh 15/01/01 00:00:00 15/01/01 01:00:00

Analysis result will be output to workload.output.path set in conf.properties.

good luck

 

app.webcenter

the Web UI for big data application management

Quick Start

Deploy and Run Dew in cluster.

set conf.properties, set database parameters or use default

	copy conf.properties.template to conf.properties 

Start WebCenter

	./start-web.sh

Login

	Web link : IP:6077
	UserName : admin
	password : admin