Twister安装/调试

How to install Twister:

See the link http://www.iterativemapreduce.org/userguide.html

 

TwisterSetting:

Set the nodes that will be used in bin/nodes

(ex. Gpu01)

Set ActiveMQ in bin/amq.properties

(ex.uri=failover\:(tcp\://amdquad01\:61616) )

Set Heap size oftwister in bin/stimr.sh

(ex. java -Xmx1096m -Xms256m-XX:SurvivorRatio=10 -XX:+AggressiveOpts -classpath $cpcgl.imr.worker.TwisterDaemon $1 $2 $3).

Set number of Damonand Nodes in twister.properties

(ex. workers_per_daemon=1)

Beforestarting Twister:

Start ActiveMQbroker:

$ACTIVEMQ_HOME/bin/activemq console  (Remember tostart ACTIVEMQ on the host you selected aboved)

See how to create subdirectory for all compute nodes.

./bin/twister.sh

Build sample

1. Go the sample directory (ex.samples/wordcount) and execute “ant”.

2. Copy the new generated jar file indist/lib to twister0.9/apps.

Data partition

1.    Split file into smallerfiles:  execute samples/wordcountsplit_input_file.sh

2.    Create a partition file:execute twister-0.9/bin/ create_partition_file.sh

**Important**Once nodes are modify,always remember to create a new partitioned file

Startrunning Twister:

After starting ActiveMQ then executebin/start_twister.sh

Startrunning Sample (wordcount):

After starting Twister, executesamples/wordcount/bin/ run_wc.sh

Stoprunning Twister:

Always remember to stop twister by executingtwister-0.9/bin/stop_twister.sh