多节点OpenStack Charms 部署指南0.0.1.dev299--16--OpenStack基础架构高可用The easyrsa resource is missing. .

目录：
第一节 多节点OpenStack Charms 部署指南0.0.1.dev223–1--OpenStack Charms 部署指南
第二节 多节点OpenStack Charms 部署指南0.0.1.dev223–2-安装MAAS

第三节 多节点OpenStack Charms 部署指南0.0.1.dev223–3-安装Juju

第四节 多节点OpenStack Charms 部署指南0.0.1.dev223–4-安装openstack

第五节 多节点OpenStack Charms 部署指南0.0.1.dev223–5--使bundle安装openstack

第六节 多节点OpenStack Charms 部署指南0.0.1.dev223–6--配置vault和设置数字证书生命周期

第七节 多节点OpenStack Charms 部署指南0.0.1.dev223–7--juju 离线部署bundle

第八节 多节点OpenStack Charms 部署指南0.0.1.dev223–8--配置 OpenStack

附录 t 多节点OpenStack Charms 部署指南0.0.1.dev223–附录T–OpenStack 高可用性

第九节 多节点OpenStack Charms 部署指南0.0.1.dev223–9--网络拓扑

第十节 多节点OpenStack Charms 部署指南0.0.1.dev223–10–OpenStack 高可用基础架构实际

第十一节 多节点OpenStack Charms 部署指南0.0.1.dev223–11–访问Juju仪表板

第十二节 多节点OpenStack Charms 部署指南0.0.1.dev223–12–OpenStack 配置openstack失败后处理

第十三节 多节点OpenStack Charms 部署指南0.0.1.dev223–13–OpenStack配置高可用后无法登陆openstack dashboard

第十四节 多节点OpenStack Charms 部署指南0.0.1.dev223–14–ssh端口转发解决IDC机房国际线路不良问题

第十五节 多节点OpenStack Charms 部署指南0.0.1.dev299–15–OpenStack 实例高可用

第十六节 多节点OpenStack Charms 部署指南0.0.1.dev299–16–OpenStack基础架构高可用The easyrsa resource is missing. .

第十七节 多节点OpenStack Charms 部署指南0.0.1.dev303–17–修改实例数量等quota上限

第十八节 多节点OpenStack Charms 部署指南0.0.1.dev303–18–backup备份

第十九节 多节点OpenStack Charms 部署指南0.0.1.dev303–19–juju log

第二十节 多节点OpenStack Charms 部署指南0.0.1.dev303–20–控制器高可用性

第二十一节 多节点OpenStack Charms 部署指南0.0.1.dev303–21–控制器备份和还原

第二十二节 多节点OpenStack Charms 部署指南0.0.1.dev223–22-- Resource: res_masakari_haproxy not running

第二十三节 多节点OpenStack Charms 部署指南0.0.1.dev223–23-登录openstack-dashboad，SSLError(SSLCertVerificationError

第二十四节 多节点OpenStack Charms 部署指南0.0.1.dev223–24-Resource: res_masakari_f8b6bde_vip not running

第二十五节 多节点OpenStack Charms 部署指南0.0.1.dev223–25–rsyslog 日志服务器构建实际

第二十六节 多节点OpenStack Charms 部署指南0.0.1.dev223–26–跨model 建立关系构建rsyslog 日志服务器构建实际

第二十七节 多节点OpenStack Charms 部署指南0.0.1.dev223–27–Charm Hook

第二十八节 多节点OpenStack Charms 部署指南0.0.1.dev223–28–Command run

第三十节 多节点OpenStack Charms 部署指南0.0.1.–30–参考体系结构—Dell EMC硬件上的Canonical Charmed OpenStack（Ussuri）

第三十一节 多节点OpenStack Charms 部署指南0.0.1.–31–vm hosting-1

第三十二节 多节点OpenStack Charms 部署指南0.0.1.–32–vm hosting-2-VM host networking (snap/2.9/UI)

第三十三节 多节点OpenStack Charms 部署指南0.0.1.–33–vm hosting-3-Adding a VM host (snap/2.9/UI)

第三十四节 多节点OpenStack Charms 部署指南0.0.1.–34–vm hosting-4-VM host存储池和创建和删除vm (snap/2.9/UI)

第三十五节 多节点OpenStack Charms 部署指南0.0.1.–35–Command export-bundle备份opensack并重新部署openstack

第三十六节 多节点openstack charms 部署指南0.0.1-36-graylog实际-1

第三十七节 多节点openstack charms 部署指南0.0.1-37-graylog实际-2

第三十八节 多节点openstack charms 部署指南0.0.1-38-graylog实际-3

第三十九节 多节点openstack charms 部署指南0.0.1-39-graylog-4-filebeat

第四十节 多节点openstack charms 部署指南0.0.1-40-prometheus2

参考文档：
Easyrsa #345
EasyRSA 3.0.8
etcd charm

部署过很多次基础架构高可用，没出现过问题，突然这次部署，easyrsa出现The easyrsa resource is missing. .。

开始困惑不解，因为以前没出现过问题，还以为以前是部署的openstack base #70，这次是部署openstack base 73，所以产生的问题。

但是又重新部署了下openstack base #70，发现还是The easyrsa resource is missing.

确定应该是网络链路的问题，没有办法访问以前能访问的earsyrsa资源。

研究了下文档，大概确认了下语法。

根据metadata.yaml中提到:

  The release of the EasyRSA software you would like to use to create
  certificate authority (CA) and other Public Key Infrastructure (PKI). 
  This charm was written using v3.0.1, so earlier versions of EasyRSA may 
  not work. You can find the releases of EasyRSA at 
  https://github.com/OpenVPN/easy-rsa/releases

wget https://github.com/OpenVPN/easy-rsa/releases/download/3.0.1/EasyRSA-3.0.1.tgz

再根据https://github.com/OpenVPN/easy-rsa/releases中语法：

juju attach etcd etcd=/path/to/new/etcd.snap

得到命令：

juju attach easyrsa easyrsa=./EasyRSA-3.0.1.tgz

注： 必须是使用.tgz后缀的文件。

juju status 

output is：

# juju status
Model      Controller       Cloud/Region    Version  SLA          Timestamp
openstack  maas-controller  mymaas/default  2.8.9    unsupported  22:23:20+08:00

App                     Version  Status  Scale  Charm                   Store       Rev  OS      Notes
ceph-mon                15.2.8   active      3  ceph-mon                local         0  ubuntu
ceph-osd                15.2.8   active      3  ceph-osd                local        15  ubuntu
ceph-radosgw            15.2.8   active      1  ceph-radosgw            local        26  ubuntu
cinder                  16.2.1   active      1  cinder                  local       136  ubuntu
cinder-ceph             16.2.1   active      1  cinder-ceph             local         2  ubuntu
cinder-mysql-router     8.0.23   active      1  mysql-router            local         0  ubuntu
dashboard-mysql-router  8.0.23   active      1  mysql-router            local         0  ubuntu
easyrsa                 3.0.1    active      1  easyrsa                 local         1  ubuntu
etcd                    3.1.10   active      3  etcd                    local         0  ubuntu
glance                  20.0.1   active      1  glance                  local       150  ubuntu
glance-mysql-router     8.0.23   active      1  mysql-router            local         0  ubuntu
keystone                17.0.0   active      1  keystone                local         0  ubuntu
keystone-mysql-router   8.0.23   active      1  mysql-router            local         0  ubuntu
mysql-innodb-cluster    8.0.23   active      3  mysql-innodb-cluster    local         0  ubuntu
neutron-api             16.2.0   active      1  neutron-api             local         0  ubuntu
neutron-api-plugin-ovn  16.2.0   active      1  neutron-api-plugin-ovn  local         0  ubuntu
neutron-mysql-router    8.0.23   active      1  mysql-router            local         0  ubuntu
nova-cloud-controller   21.1.1   active      1  nova-cloud-controller   local       501  ubuntu
nova-compute            21.1.1   active      3  nova-compute            local       133  ubuntu
nova-mysql-router       8.0.23   active      1  mysql-router            local         0  ubuntu
ntp                     3.5      active      3  ntp                     local         0  ubuntu
openstack-dashboard     18.3.2   active      1  openstack-dashboard     local        32  ubuntu
ovn-central             20.03.1  active      3  ovn-central             local         0  ubuntu
ovn-chassis             20.03.1  active      3  ovn-chassis             local         0  ubuntu
placement               3.0.0    active      1  placement               local         0  ubuntu
placement-mysql-router  8.0.23   active      1  mysql-router            local         0  ubuntu
rabbitmq-server         3.8.2    active      1  rabbitmq-server         local       150  ubuntu
vault                   1.5.4    active      3  vault                   local         0  ubuntu
vault-hacluster                  active      3  hacluster               jujucharms   74  ubuntu
vault-mysql-router      8.0.23   active      3  mysql-router            local         0  ubuntu

Unit                         Workload  Agent  Machine  Public address  Ports              Message
ceph-mon/0                   active    idle   0/lxd/0  10.0.7.233                         Unit is ready and clustered
ceph-mon/1                   active    idle   1/lxd/0  10.0.7.240                         Unit is ready and clustered
ceph-mon/2*                  active    idle   2/lxd/0  10.0.7.227                         Unit is ready and clustered
ceph-osd/0*                  active    idle   0        10.0.0.156                         Unit is ready (1 OSD)
ceph-osd/1                   active    idle   1        10.0.0.157                         Unit is ready (1 OSD)
ceph-osd/2                   active    idle   2        10.0.0.158                         Unit is ready (1 OSD)
ceph-radosgw/0*              active    idle   0/lxd/1  10.0.7.238      80/tcp             Unit is ready
cinder/0*                    active    idle   1/lxd/1  10.0.7.242      8776/tcp           Unit is ready
  cinder-ceph/0*             active    idle            10.0.7.242                         Unit is ready
  cinder-mysql-router/0*     active    idle            10.0.7.242                         Unit is ready
easyrsa/1*                   active    idle   0/lxd/9  10.0.7.252                         Certificate Authority connected.
etcd/0                       active    idle   0/lxd/7  10.0.7.248      2379/tcp           Healthy with 3 known peers
etcd/1*                      active    idle   1/lxd/7  10.0.7.250      2379/tcp           Healthy with 3 known peers
etcd/2                       active    idle   2/lxd/7  10.0.7.249      2379/tcp           Healthy with 3 known peers
glance/0*                    active    idle   2/lxd/1  10.0.7.228      9292/tcp           Unit is ready
  glance-mysql-router/0*     active    idle            10.0.7.228                         Unit is ready
keystone/0*                  active    idle   0/lxd/2  10.0.7.237      5000/tcp           Unit is ready
  keystone-mysql-router/0*   active    idle            10.0.7.237                         Unit is ready
mysql-innodb-cluster/0       active    idle   0/lxd/3  10.0.7.236                         Unit is ready: Mode: R/O
mysql-innodb-cluster/1       active    idle   1/lxd/2  10.0.7.245                         Unit is ready: Mode: R/O
mysql-innodb-cluster/2*      active    idle   2/lxd/2  10.0.7.231                         Unit is ready: Mode: R/W
neutron-api/0*               active    idle   1/lxd/3  10.0.7.241      9696/tcp           Unit is ready
  neutron-api-plugin-ovn/0*  active    idle            10.0.7.241                         Unit is ready
  neutron-mysql-router/0*    active    idle            10.0.7.241                         Unit is ready
nova-cloud-controller/0*     active    idle   0/lxd/4  10.0.7.239      8774/tcp,8775/tcp  Unit is ready
  nova-mysql-router/0*       active    idle            10.0.7.239                         Unit is ready
nova-compute/0*              active    idle   0        10.0.0.156                         Unit is ready
  ntp/1                      active    idle            10.0.0.156      123/udp            chrony: Ready
  ovn-chassis/1              active    idle            10.0.0.156                         Unit is ready
nova-compute/1               active    idle   1        10.0.0.157                         Unit is ready
  ntp/2                      active    idle            10.0.0.157      123/udp            chrony: Ready
  ovn-chassis/2              active    idle            10.0.0.157                         Unit is ready
nova-compute/2               active    idle   2        10.0.0.158                         Unit is ready
  ntp/0*                     active    idle            10.0.0.158      123/udp            chrony: Ready
  ovn-chassis/0*             active    idle            10.0.0.158                         Unit is ready
openstack-dashboard/0*       active    idle   1/lxd/4  10.0.7.244      80/tcp,443/tcp     Unit is ready
  dashboard-mysql-router/0*  active    idle            10.0.7.244                         Unit is ready
ovn-central/0                active    idle   0/lxd/5  10.0.7.235      6641/tcp,6642/tcp  Unit is ready (northd: active)
ovn-central/1                active    idle   1/lxd/5  10.0.7.243      6641/tcp,6642/tcp  Unit is ready
ovn-central/2*               active    idle   2/lxd/3  10.0.7.232      6641/tcp,6642/tcp  Unit is ready (leader: ovnnb_db, ovnsb_db)
placement/0*                 active    idle   2/lxd/4  10.0.7.229      8778/tcp           Unit is ready
  placement-mysql-router/0*  active    idle            10.0.7.229                         Unit is ready
rabbitmq-server/0*           active    idle   2/lxd/5  10.0.7.230      5672/tcp           Unit is ready
vault/0*                     active    idle   0/lxd/6  10.0.7.234      8200/tcp           Unit is ready (active: true, mlock: disabled)
  vault-hacluster/0*         active    idle            10.0.7.234                         Unit is ready and clustered
  vault-mysql-router/0*      active    idle            10.0.7.234                         Unit is ready
vault/1                      active    idle   1/lxd/6  10.0.7.247      8200/tcp           Unit is ready (active: true, mlock: disabled)
  vault-hacluster/1          active    idle            10.0.7.247                         Unit is ready and clustered
  vault-mysql-router/1       active    idle            10.0.7.247                         Unit is ready
vault/2                      active    idle   2/lxd/6  10.0.7.246      8200/tcp           Unit is ready (active: true, mlock: disabled)
  vault-hacluster/2          active    idle            10.0.7.246                         Unit is ready and clustered
  vault-mysql-router/2       active    idle            10.0.7.246                         Unit is ready

Machine  State    DNS         Inst id              Series  AZ       Message
0        started  10.0.0.156  node2                focal   default  Deployed
0/lxd/0  started  10.0.7.233  juju-700a13-0-lxd-0  focal   default  Container started
0/lxd/1  started  10.0.7.238  juju-700a13-0-lxd-1  focal   default  Container started
0/lxd/2  started  10.0.7.237  juju-700a13-0-lxd-2  focal   default  Container started
0/lxd/3  started  10.0.7.236  juju-700a13-0-lxd-3  focal   default  Container started
0/lxd/4  started  10.0.7.239  juju-700a13-0-lxd-4  focal   default  Container started
0/lxd/5  started  10.0.7.235  juju-700a13-0-lxd-5  focal   default  Container started
0/lxd/6  started  10.0.7.234  juju-700a13-0-lxd-6  focal   default  Container started
0/lxd/7  started  10.0.7.248  juju-700a13-0-lxd-7  focal   default  Container started
0/lxd/9  started  10.0.7.252  juju-700a13-0-lxd-9  focal   default  Container started
1        started  10.0.0.157  node1                focal   default  Deployed
1/lxd/0  started  10.0.7.240  juju-700a13-1-lxd-0  focal   default  Container started
1/lxd/1  started  10.0.7.242  juju-700a13-1-lxd-1  focal   default  Container started
1/lxd/2  started  10.0.7.245  juju-700a13-1-lxd-2  focal   default  Container started
1/lxd/3  started  10.0.7.241  juju-700a13-1-lxd-3  focal   default  Container started
1/lxd/4  started  10.0.7.244  juju-700a13-1-lxd-4  focal   default  Container started
1/lxd/5  started  10.0.7.243  juju-700a13-1-lxd-5  focal   default  Container started
1/lxd/6  started  10.0.7.247  juju-700a13-1-lxd-6  focal   default  Container started
1/lxd/7  started  10.0.7.250  juju-700a13-1-lxd-7  focal   default  Container started
2        started  10.0.0.158  node3                focal   default  Deployed
2/lxd/0  started  10.0.7.227  juju-700a13-2-lxd-0  focal   default  Container started
2/lxd/1  started  10.0.7.228  juju-700a13-2-lxd-1  focal   default  Container started
2/lxd/2  started  10.0.7.231  juju-700a13-2-lxd-2  focal   default  Container started
2/lxd/3  started  10.0.7.232  juju-700a13-2-lxd-3  focal   default  Container started
2/lxd/4  started  10.0.7.229  juju-700a13-2-lxd-4  focal   default  Container started
2/lxd/5  started  10.0.7.230  juju-700a13-2-lxd-5  focal   default  Container started
2/lxd/6  started  10.0.7.246  juju-700a13-2-lxd-6  focal   default  Container started
2/lxd/7  started  10.0.7.249  juju-700a13-2-lxd-7  focal   default  Container started