多节点OpenStack Charms 部署指南0.0.1.dev223--22-- Resource: res_masakari

本文链接：https://blog.csdn.net/m0_49212388/article/details/115438254

参考文档：

重新部署masakari后，突然出现 Resource: res_masakari_haproxy not running。

masakari/0*                  active       idle        1/lxd/2   10.0.2.123      15868/tcp          Unit is ready
  hacluster/0*               blocked      idle                  10.0.2.123                         Resource: res_masakari_haproxy not running
  masakari-mysql-router/0*   active       idle                  10.0.2.123                         Unit is ready
masakari/1                   active       idle        2/lxd/2   10.0.2.134      15868/tcp          Unit is ready
  hacluster/2                blocked      idle                  10.0.2.134                         Resource: res_masakari_haproxy not running
  masakari-mysql-router/2    active       idle                  10.0.2.134                         Unit is ready
masakari/2                   active       idle        3/lxd/0   10.0.2.120      15868/tcp          Unit is ready
  hacluster/1                blocked      idle                  10.0.2.120                         Resource: res_masakari_haproxy not running
  masakari-mysql-router/1    active       idle                  10.0.2.120                         Unit is ready

开始以为又是keystone传递ssl的问题，就删除keystone，重新部署keystone，但是还是出现 Resource: res_masakari_haproxy not running。

查找资料后，发现以前有类似的Bug: #1839021，处理方法是重新激活下crm。

原文大意：
Bug：＃1839021：高可用集群charm"Resource: res_ks_haproxy not running" 资源：res_ks_haproxy未运行。

对于高可用性部署，在执行从Trusty到Xenial的升级时，如果Keystone单元花费很长时间重新启动并重新启动其服务，则该Keystone的hacluster crm监视器可能会耗尽其重试并显示状态消息Resource处于阻止状态：res_ks_haproxy未运行。
在这种情况下，在关联的keystone单元完成升级后，对受影响的主机单元执行以下操作应该可以解决该问题

juju run --unit <unit> sudo crm resource refresh

这里用” <unit> “代替的是keystone/0

根据这个，大致可以判断，使用hacluster的高可用集群，应该都使用了crm来监测状态并可能耗尽重试次数。所以可以试试类似的命令如下：

juju run --unit masakari/0 sudo crm resource refresh
juju run --unit masakari/1 sudo crm resource refresh
juju run --unit masakari/2 sudo crm resource refresh

果然，这样操作后，masakari/1和masakari/2陆续恢复了正常

masakari/0*                  active    idle   1/lxd/2   10.0.2.123      15868/tcp          Unit is ready
  hacluster/0*               blocked   idle             10.0.2.123                         Resource: res_masakari_haproxy not running
  masakari-mysql-router/0*   active    idle             10.0.2.123                         Unit is ready
masakari/1                   active    idle   2/lxd/2   10.0.2.134      15868/tcp          Unit is ready
  hacluster/2                active    idle             10.0.2.134                         Unit is ready and clustered
  masakari-mysql-router/2    active    idle             10.0.2.134                         Unit is ready
masakari/2                   active    idle   3/lxd/0   10.0.2.120      15868/tcp          Unit is ready
  hacluster/1                active    idle             10.0.2.120                         Unit is ready and clustered
  masakari-mysql-router/1    active    idle             10.0.2.120                         Unit is ready

看来需要将masakari/0暂停下：

juju run-action masakari/0 pause --wait



unit-masakari-0:
  UnitId: masakari/0
  id: "32"
  results:
    Stderr: |
      Synchronizing state of apache2.service with SysV service script with /lib/systemd/systemd-sysv-install.
      Executing: /lib/systemd/systemd-sysv-install disable apache2
      Removed /etc/systemd/system/multi-user.target.wants/apache2.service.
      Created symlink /etc/systemd/system/apache2.service → /dev/null.
      Synchronizing state of masakari-engine.service with SysV service script with /lib/systemd/systemd-sysv-install.
      Executing: /lib/systemd/systemd-sysv-install disable masakari-engine
      Removed /etc/systemd/system/multi-user.target.wants/masakari-engine.service.
      Created symlink /etc/systemd/system/masakari-engine.service → /dev/null.
      Synchronizing state of memcached.service with SysV service script with /lib/systemd/systemd-sysv-install.
      Executing: /lib/systemd/systemd-sysv-install disable memcached
      Removed /etc/systemd/system/multi-user.target.wants/memcached.service.
      Created symlink /etc/systemd/system/memcached.service → /dev/null.
      Synchronizing state of haproxy.service with SysV service script with /lib/systemd/systemd-sysv-install.
      Executing: /lib/systemd/systemd-sysv-install disable haproxy
      Removed /etc/systemd/system/multi-user.target.wants/haproxy.service.
      Created symlink /etc/systemd/system/haproxy.service → /dev/null.
    Stdout: |
      active
      active
      active
      inactive
      inactive
      inactive
      inactive
  status: completed
  timing:
    completed: 2021-04-05 01:28:36 +0000 UTC
    enqueued: 2021-04-05 01:27:58 +0000 UTC
    started: 2021-04-05 01:28:09 +0000 UTC

再恢复masakari/0的运行：

juju run-action masakari/0 resume --wait
unit-masakari-0:
  UnitId: masakari/0
  id: "34"
  results:
    Stderr: |
      Removed /etc/systemd/system/apache2.service.
      Synchronizing state of apache2.service with SysV service script with /lib/systemd/systemd-sysv-install.
      Executing: /lib/systemd/systemd-sysv-install enable apache2
      Created symlink /etc/systemd/system/multi-user.target.wants/apache2.service → /lib/systemd/system/apache2.service.
      Removed /etc/systemd/system/masakari-engine.service.
      Synchronizing state of masakari-engine.service with SysV service script with /lib/systemd/systemd-sysv-install.
      Executing: /lib/systemd/systemd-sysv-install enable masakari-engine
      Created symlink /etc/systemd/system/multi-user.target.wants/masakari-engine.service → /lib/systemd/system/masakari-engine.service.
      Removed /etc/systemd/system/memcached.service.
      Synchronizing state of memcached.service with SysV service script with /lib/systemd/systemd-sysv-install.
      Executing: /lib/systemd/systemd-sysv-install enable memcached
      Created symlink /etc/systemd/system/multi-user.target.wants/memcached.service → /lib/systemd/system/memcached.service.
      Removed /etc/systemd/system/haproxy.service.
      Synchronizing state of haproxy.service with SysV service script with /lib/systemd/systemd-sysv-install.
      Executing: /lib/systemd/systemd-sysv-install enable haproxy
      Created symlink /etc/systemd/system/multi-user.target.wants/haproxy.service → /lib/systemd/system/haproxy.service.
    Stdout: |
      inactive
      inactive
      inactive
      inactive
      active
      active
  status: completed
  timing:
    completed: 2021-04-05 01:29:28 +0000 UTC
    enqueued: 2021-04-05 01:29:16 +0000 UTC
    started: 2021-04-05 01:29:16 +0000 UTC

juju status masakari：

masakari/0*                  active    idle   1/lxd/2   10.0.2.123      15868/tcp          Unit is ready
  hacluster/0*               blocked   idle             10.0.2.123                         Resource: res_masakari_haproxy not running
  masakari-mysql-router/0*   active    idle             10.0.2.123                         Unit is ready

再次刷新:

juju run --unit masakari/0 sudo crm resource refresh
Waiting for 1 reply from the controller. OK

再过了一会，juju status masakari：

masakari/0*                           active       idle        1/lxd/2   10.0.2.123      15868/tcp          Unit is ready
  hacluster/0*                        active       idle                  10.0.2.123                         Unit is ready and clustered
  masakari-mysql-router/0*            active       idle                  10.0.2.123                         Unit is ready
masakari/1                            active       idle        2/lxd/2   10.0.2.134      15868/tcp          Unit is ready
  hacluster/2                         active       idle                  10.0.2.134                         Unit is ready and clustered
  masakari-mysql-router/2             active       idle                  10.0.2.134                         Unit is ready
masakari/2                            active       idle        3/lxd/0   10.0.2.120      15868/tcp          Unit is ready
  hacluster/1                         active       idle                  10.0.2.120                         Unit is ready and clustered
  masakari-mysql-router/1             active       idle                  10.0.2.120                         Unit is ready