53.CM Server服务在RedHat7状态显示异常分析

53.1 问题介绍

在RedHat服务器上使用“systemctl status cloudera-scm-server”命令查看cloudera-scm-server服务状态为exited（正常的服务应该是active(running)），显示如下：

[ec2-user@ip-172-31-22-86~]$ systemctl status cloudera-scm-server
●cloudera-scm-server.service- LSB:Cloudera SCM Server
   Loaded: loaded (/etc/rc.d/init.d/cloudera-scm-server; bad; vendor preset: disabled)
   Active: active (exited)since Mon 2017-11-13 09:27:27 EST; 14min ago
     Docs: man:systemd-sysv-generator(8)
  Process: 788 ExecStart=/etc/rc.d/init.d/cloudera-scm-serverstart (code=exited, status=0/SUCCESS)

Nov 13 09:27:21ip-172-31-22-86.ap-southeast-1.compute.internal systemd[1]: Starting LSB:Clou...
Nov 13 09:27:22ip-172-31-22-86.ap-southeast-1.compute.internal su[928]: (to cloudera-scm) roo...
Nov 13 09:27:27 ip-172-31-22-86.ap-southeast-1.compute.internalcloudera-scm-server[788]: Star...
Nov 13 09:27:27ip-172-31-22-86.ap-southeast-1.compute.internal systemd[1]: Started LSB:Cloud...
Hint: Some lines were ellipsized, use-l to show in full.
[ec2-user@ip-172-31-22-86~]$

53.2 问题分析与解决

• 在使用systemctl status cloudera-scm-server输出CM服务器的状态时，因为OS检测到Cloudera Manager启动后，不知道如何跟踪Cloudera Manager的状态导致。
• 查看CM服务器状态方式
  • 以下为在服务器上查看Cloudera Manager服务状态是否正常的几种方式。
  • 使用“ps –ef”命令来检查Cloudera Manager的后台进程

[ec2-user@ip-172-31-22-86 ~]$ ps -ef |grep cloudera-scm-server
clouder+   986   928 19 09:27 ?        00:07:25 /usr/java/jdk1.7.0_67-cloudera/bin/java -cp .:lib/*:/usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar -server -Dlog4j.configuration=file:/etc/cloudera-scm-server/log4j.properties -Dfile.encoding=UTF-8 -Dcmf.root.logger=INFO,LOGFILE -Dcmf.log.dir=/var/log/cloudera-scm-server -Dcmf.log.file=cloudera-scm-server.log -Dcmf.jetty.threshhold=WARN -Dcmf.schema.dir=/usr/share/cmf/schema -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -Dpython.home=/usr/share/cmf/python -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:+HeapDumpOnOutOfMemoryError -Xmx2G -XX:MaxPermSize=256m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp -XX:OnOutOfMemoryError=kill -9 %p com.cloudera.server.cmf.Main
ec2-user 29038 19145  0 10:05 pts/0    00:00:00 grep --color=auto cloudera-scm-server

• 通过查看/var/log/cloudera-scm-server/cloudera-scm-server.log的方式
  • 显示”ScmActivecompleted successfully”信息则表示CM服务启动成功。

<pre style="margin: 0px; padding: 0px; max-width: 100%; box-sizing: border-box !important; overflow-wrap: break-word !important; color: rgb(51, 51, 51); font-size: 17px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: 0.544px; orphans: 2; text-align: justify; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial; background-color: rgb(202, 230, 202);">[root@ip-172-31-22-86 cloudera-scm-server]# pwd /var/log/cloudera-scm-server
[root@ip-172-31-22-86 cloudera-scm-server]# tail -f cloudera-scm-server.log
2017-11-13 10:41:08,960 INFO 1253652960@agentServer-2:com.cloudera.server.common.MonitoringThreadPool: agentServer: execution stats: average=61ms, min=16ms, max=6633ms.</pre>

<pre style="margin: 0px; padding: 0px; max-width: 100%; box-sizing: border-box !important; overflow-wrap: break-word !important; color: rgb(51, 51, 51); font-size: 17px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: 0.544px; orphans: 2; text-align: justify; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial; background-color: rgb(202, 230, 202);">2017-11-13 10:41:08,960 INFO 1253652960@agentServer-2:com.cloudera.server.common.MonitoringThreadPool: agentServer: waiting in queue stats: average=0ms, min=0ms, max=34ms.</pre>

<pre style="margin: 0px; padding: 0px; max-width: 100%; box-sizing: border-box !important; overflow-wrap: break-word !important; color: rgb(51, 51, 51); font-size: 17px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: 0.544px; orphans: 2; text-align: justify; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial; background-color: rgb(202, 230, 202);">2017-11-13 10:41:13,625 INFO ScmActive-0:com.cloudera.server.cmf.components.ScmActive: (119 skipped) ScmActive completed successfully.</pre>

• 使用“netstat –apn |grep 7180”方式
  • 7180端口被监听则表示CM服务启动成功。

[root@ip-172-31-22-86 cloudera-scm-server]# netstat -apn |grep 7180
tcp        0      0 0.0.0.0:7180            0.0.0.0:*               LISTEN      30821/java
[root@ip-172-31-22-86 cloudera-scm-server]#

总结

• CM的agent服务也会有这个问题，通过systemctl status cloudera-scm-agent也无法查看agent的正确状态。
  • 具体也可以通过进程，日志和端口来判断服务是否正常。

大数据视频推荐：
CSDN
大数据语音推荐：
企业级大数据技术应用
大数据机器学习案例之推荐系统
自然语言处理
大数据基础
人工智能：深度学习入门到精通