tune performance

The following ending with ‘~’ should override the default value.
Inter-worker:
Netty.server.thread(Netty-server-localhost-670X-worker-N)[storm.messaging.netty.server_worker_threads] [NioServerSocketChannelFactory] 1 ~
Netty.client.thread(client-worker-N) [storm.messaging.netty.client_worker_threads] 1 ~
Netty.tcp.buffer [storm.messaging.netty.buffer_size] [child.receiveBufferSize|sendBufferSize] 5MB(storm-yarn default 1MB) ~
Netty.send.buffer [storm.messaging.netty.transfer.batch.size] 256KB

Intra-worker:
Worker.receive.thread(Thread-n-worker-receiver-thread-N) [topology.worker.receiver.thread.count] 1 ~
Worker.send.thread(Thread-n-disruptor-worker-transfer-queue) 1
Worker.receive.buffer [topology.receiver.buffer.size] 8
Worker.send.buffer [topology.transfer.buffer.size] 1024

Executor.task.thread(Thread-n-{task}) [spout/bolt parallelism_hint|topology.acker.executors] ~
Executor.send.thread(Thread-n-disruptor-executor[m m]-send-queue) 1/executor
Executor.receive.buffer [disruptor] [topology.executor.receive.buffer.size] 1024 ~
Executor.send.buffer [disruptor] [topology.executor.send.buffer.size] 1024 ~

  1. Executor.task.thread不仅包括用户写的spout、bolt task,还包括系统的acker task,它们都有对应的Executor.send.thread;
  2. Worker进程内除了上面所列举的线程外,还有metrics-meter-tick-thread和timer tasks,timer tasks如下:user-timer
    executor-heartbeat-timer
    refresh-active-timer
    refresh-connections-timer
    heartbeat-timer
  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值