Metron学习5_Install/Deploy Metron to the Cluster过程及出现的问题

最新推荐文章于 2018-08-14 14:29:54 发布

Wang_Zhenwei

最新推荐文章于 2018-08-14 14:29:54 发布

阅读量1k

点赞数

分类专栏： Metron 原创文章标签： Metron

本文链接：https://blog.csdn.net/wang_zhenwei/article/details/53558475

版权

原创同时被 2 个专栏收录

105 篇文章 0 订阅

订阅专栏

Metron

12 篇文章 2 订阅

订阅专栏

Note: Adding -u user -k to the below command lines allows deployment in environments where passwordless SSH has not been enabled.

cd /root/incubator-metron/metron-deployment/playbooks
Run the following ansible command to deploy Metron with the standard services (Metron Topologies, WebUI, and Monit)
ansible-playbook -i /root/incubator-metron/metron-deployment/inventory/$INSTALL_CONF_DIRECTORY metron_install.yml --skip-tags="solr"
Run the following Ansible command to deploy Metron without installing Sensors
ansible-playbook -i /root/incubator-metron/metron-deployment/inventory/$INSTALL_CONF_DIRECTORY metron_install.yml --skip-tags="solr,sensors"

这三条安装命令在本机上为：

cd /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/playbooks

ansible-playbook -i /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/inventory/installConf metron_install.yml --skip-tags="solr"

ansible-playbook -i /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/inventory/installConf metron_install.yml --skip-tags="solr,sensors"

安装过程为：

[root@master playbooks]# ansible-playbook -i /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/inventory/installConf metron_install.yml --skip-tags="solr"
 [WARNING]: While constructing a mapping from /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/inventory/installConf/group_vars/all, line 19, column 1, found a duplicate dict
key (sniff_interface). Using last defined value only.


PLAY [metron] ******************************************************************

TASK [setup] *******************************************************************
ok: [master]
ok: [slave2]
ok: [slave1]

TASK [epel : Get epel-repo rpm] ************************************************
changed: [master]
changed: [slave2]
changed: [slave1]

TASK [epel : Install epel-repo rpm] ********************************************
ok: [slave2]
ok: [slave1]
ok: [master]

TASK [ntp : Install ntp] *******************************************************
ok: [slave2]
ok: [slave1]
ok: [master]

TASK [ntp : Ensure ntp is running and enabled] *********************************
ok: [slave2]
ok: [slave1]
ok: [master]

TASK [metron_common : Check OS Version] ****************************************
skipping: [slave1]
skipping: [slave2]
skipping: [master]

TASK [metron_common : Check for Metron jar path] *******************************
ok: [slave2]
ok: [slave1]
ok: [master]

TASK [metron_common : Verify Metron jars exist] ********************************
fatal: [master]: FAILED! => {"changed": false, "failed": true, "msg": "Unable to locate staged Metron jars at /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/playbooks/../../metron-platform/metron-elasticsearch/target/metron-elasticsearch-0.2.0BETA.jar.  Did you run 'mvn package'?"}
skipping: [slave2]
skipping: [slave1]

TASK [metron_common : Ensure iptables is stopped and is not running at boot time.] ***
ok: [slave2]
changed: [slave1]

PLAY [search] ******************************************************************

TASK [setup] *******************************************************************
ok: [slave2]
ok: [slave1]

TASK [java_jdk : Check for java at "/usr/jdk64/jdk1.8.0_40"] *******************
ok: [slave1]
ok: [slave2]

TASK [java_jdk : Alternatives link for java] ***********************************
skipping: [slave1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/java', u'link': u'/usr/bin/java', u'name': u'java'}) 
skipping: [slave2] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/java', u'link': u'/usr/bin/java', u'name': u'java'}) 
skipping: [slave1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/jar', u'link': u'/usr/bin/jar', u'name': u'jar'}) 
skipping: [slave2] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/jar', u'link': u'/usr/bin/jar', u'name': u'jar'}) 

TASK [java_jdk : Install openjdk] **********************************************
changed: [slave1] => (item=[u'java-1.8.0-openjdk', u'java-1.8.0-openjdk-devel'])
changed: [slave2] => (item=[u'java-1.8.0-openjdk', u'java-1.8.0-openjdk-devel'])

TASK [epel : Get epel-repo rpm] ************************************************
ok: [slave2]
ok: [slave1]

TASK [epel : Install epel-repo rpm] ********************************************
ok: [slave2]
ok: [slave1]

TASK [python-pip : Install python-pip] *****************************************
changed: [slave2]
changed: [slave1]

TASK [httplib2 : Install python httplib2 dependency] ***************************
changed: [slave1]
changed: [slave2]

TASK [libselinux-python : Install libselinux-python] ***************************
ok: [slave2]
ok: [slave1]

TASK [elasticsearch : Add Elasticsearch GPG key] *******************************
changed: [slave2]
changed: [slave1]

TASK [elasticsearch : Add Elasticsearch repository] ****************************
changed: [slave2]
changed: [slave1]

TASK [elasticsearch : Install Elasticsearch] ***********************************
changed: [slave2]
changed: [slave1]

TASK [elasticsearch : Create Data Directories] *********************************
changed: [slave2] => (item=/data1/elasticsearch)
changed: [slave1] => (item=/data1/elasticsearch)
changed: [slave2] => (item=/data2/elasticsearch)
changed: [slave1] => (item=/data2/elasticsearch)

TASK [elasticsearch : Configure Elasticsearch - remove stale entries] **********
ok: [slave2] => (item=^cluster\.name:)
ok: [slave1] => (item=^cluster\.name:)
ok: [slave2] => (item=^network\.host:)
ok: [slave1] => (item=^network\.host:)
ok: [slave2] => (item=^discovery\.zen\.ping\.unicast\.hosts:)
ok: [slave1] => (item=^discovery\.zen\.ping\.unicast\.hosts:)
ok: [slave2] => (item=^path\.data)
ok: [slave1] => (item=^path\.data)

TASK [elasticsearch : Configure Elasticsearch] *********************************
changed: [slave1] => (item={u'regexp': u'^# *cluster\\.name:', u'line': u'cluster.name: metron'})
changed: [slave2] => (item={u'regexp': u'^# *cluster\\.name:', u'line': u'cluster.name: metron'})
changed: [slave1] => (item={u'regexp': u'^# *network\\.host:', u'line': u'network.host: _eth0:ipv4_'})
changed: [slave2] => (item={u'regexp': u'^# *network\\.host:', u'line': u'network.host: _eth0:ipv4_'})
changed: [slave1] => (item={u'regexp': u'^# *discovery\\.zen\\.ping\\.unicast\\.hosts:', u'line': u'discovery.zen.ping.unicast.hosts: [ master,slave1,slave2 ]'})
changed: [slave2] => (item={u'regexp': u'^# *discovery\\.zen\\.ping\\.unicast\\.hosts:', u'line': u'discovery.zen.ping.unicast.hosts: [ master,slave1,slave2 ]'})
changed: [slave1] => (item={u'regexp': u'^# *path\\.data', u'line': u'path.data: /data1/elasticsearch,/data2/elasticsearch'})
changed: [slave2] => (item={u'regexp': u'^# *path\\.data', u'line': u'path.data: /data1/elasticsearch,/data2/elasticsearch'})

TASK [elasticsearch : Create Logrotate Script for Elasticsearch] ***************
changed: [slave1]
changed: [slave2]

TASK [metron_elasticsearch_templates : Start Elasticsearch] ********************
fatal: [slave2]: FAILED! => {"changed": false, "failed": true, "msg": "Exception in thread \"main\" java.lang.IllegalArgumentException: No interface named 'eth0' found, got [name:lo (lo), name:em1 (em1)]\n\tat org.elasticsearch.common.network.NetworkUtils.getAddressesForInterface(NetworkUtils.java:232)\n\tat org.elasticsearch.common.network.NetworkService.resolveInternal(NetworkService.java:257)\n\tat org.elasticsearch.common.network.NetworkService.resolveInetAddresses(NetworkService.java:209)\n\tat org.elasticsearch.common.network.NetworkService.resolveBindHostAddresses(NetworkService.java:122)\n\tat org.elasticsearch.transport.netty.NettyTransport.bindServerBootstrap(NettyTransport.java:435)\n\tat org.elasticsearch.transport.netty.NettyTransport.doStart(NettyTransport.java:332)\n\tat org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\tat org.elasticsearch.transport.TransportService.doStart(TransportService.java:182)\n\tat org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\tat org.elasticsearch.node.Node.start(Node.java:278)\n\tat org.elasticsearch.bootstrap.Bootstrap.start(Bootstrap.java:222)\n\tat org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:288)\n\tat org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:35)\nRefer to the log for complete error details.\n"}
fatal: [slave1]: FAILED! => {"changed": false, "failed": true, "msg": "Exception in thread \"main\" java.lang.IllegalArgumentException: No interface named 'eth0' found, got [name:lo (lo), name:em1 (em1), name:docker0 (docker0)]\n\tat org.elasticsearch.common.network.NetworkUtils.getAddressesForInterface(NetworkUtils.java:232)\n\tat org.elasticsearch.common.network.NetworkService.resolveInternal(NetworkService.java:257)\n\tat org.elasticsearch.common.network.NetworkService.resolveInetAddresses(NetworkService.java:209)\n\tat org.elasticsearch.common.network.NetworkService.resolveBindHostAddresses(NetworkService.java:122)\n\tat org.elasticsearch.transport.netty.NettyTransport.bindServerBootstrap(NettyTransport.java:435)\n\tat org.elasticsearch.transport.netty.NettyTransport.doStart(NettyTransport.java:332)\n\tat org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\tat org.elasticsearch.transport.TransportService.doStart(TransportService.java:182)\n\tat org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\tat org.elasticsearch.node.Node.start(Node.java:278)\n\tat org.elasticsearch.bootstrap.Bootstrap.start(Bootstrap.java:222)\n\tat org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:288)\n\tat org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:35)\nRefer to the log for complete error details.\n"}

PLAY [search] ******************************************************************

PLAY [mysql] *******************************************************************

PLAY [ambari_slave] ************************************************************

PLAY [metron_hbase_tables] *****************************************************

PLAY [metron_kafka_topics] *****************************************************

PLAY [enrichment] **************************************************************

PLAY [pcap_server] *************************************************************

PLAY [web] *********************************************************************

PLAY [sensors] *****************************************************************

PLAY [metron] ******************************************************************

PLAY [metron] ******************************************************************
	to retry, use: --limit @/home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/playbooks/metron_install.retry

PLAY RECAP *********************************************************************
master                     : ok=6    changed=1    unreachable=0    failed=1   
slave1                     : ok=22   changed=11   unreachable=0    failed=1   
slave2                     : ok=22   changed=10   unreachable=0    failed=1

重点关注两处失败：

TASK [metron_elasticsearch_templates : Start Elasticsearch] ********************
fatal: [slave2]: FAILED! => {"changed": false, "failed": true, "msg":

"Exception in thread \"main\" java.lang.IllegalArgumentException:

No interface named 'eth0' found, got [name:lo (lo), name:em1 (em1)]\n\t

at org.elasticsearch.common.network.NetworkUtils.getAddressesForInterface(NetworkUtils.java:232)\n\t

at org.elasticsearch.common.network.NetworkService.resolveInternal(NetworkService.java:257)\n\t

at org.elasticsearch.common.network.NetworkService.resolveInetAddresses(NetworkService.java:209)\n\t

at org.elasticsearch.common.network.NetworkService.resolveBindHostAddresses(NetworkService.java:122)\n\t

at org.elasticsearch.transport.netty.NettyTransport.bindServerBootstrap(NettyTransport.java:435)\n\t

at org.elasticsearch.transport.netty.NettyTransport.doStart(NettyTransport.java:332)\n\t

at org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\t

at org.elasticsearch.transport.TransportService.doStart(TransportService.java:182)\n\t

at org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\t

at org.elasticsearch.node.Node.start(Node.java:278)\n\tat org.elasticsearch.bootstrap.Bootstrap.start(Bootstrap.java:222)\n\t

at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:288)\n\t

at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:35)\nRefer to the log for complete error details.\n"}
fatal: [slave1]: FAILED! => {"changed": false, "failed": true, "msg": "Exception in thread \"main\" java.lang.IllegalArgumentException:

No interface named 'eth0' found, got [name:lo (lo), name:em1 (em1), name:docker0 (docker0)]\n\t