Storm集群参数调整

Supervisor 参数调整

• 修改${STORM_HOME}conf/storm.yaml文件内容

supervisor变更参数

• slots 配置：
  • 若storm host仅仅执行supervisor(不包含nimbus)时，slots数目 = (Memory GB - 1 )
  • 若同时包含了storm nimbus、ui、supervisor时，slots = (Memory GB - 1 )

supervisor.slots.ports

• worker.childopts 配置：

worker.childopts: "-Xmx1g -Xms1g -server -XX:+UseCompressedOops -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC"

supervisor重启脚本

spid=`jps | grep supervisor | awk '{print $1}'`

if [ "x${spid}" != "x" ]
then
    kill ${spid}
    storm supervisor
fi

nimbus与ui 参数调整

• worker.childopts影响storm ui页面展示信息，因此也调整和supervisor一致

worker.childopts: "-Xmx1g -Xms1g -server -XX:+UseCompressedOops -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC"

nimbus重启

npid=`jps | grep nimbus | awk '{print $1}'`

if [ "x${npid}" != "x" ]
then
    kill ${npid}
    storm nimbus
fi

ui重启

nimbus重启

upid=`jps | grep core | awk '{print $1}'`

if [ "x${upid}" != "x" ]
then
    kill ${upid}
    storm nimbus
fi

转载于:https://www.cnblogs.com/senlinyang/p/8116617.html