问题一、
问题原因:免密登陆的问题
解决:1、查看install options中的id_rsa文件是否正确(要当初构建环境的ambari主服务节点的)
- 查看SSH User Account 是否正确(我是root用户)
- 以上用户的免密登陆是否成功
问题二:
以上截图中:Creating target directory...
原因是:
问题三:
yarn需要设置定时重启,不然服务器top查看load average会达到20多,程序通过yarn请求资源会超时。
restart_yarn.sh
curl -u admin:admin -H "X-Requested-By: ambari" -X POST 'http://localhost:8080/api/v1/clusters/producer/requests' -d '{"RequestInfo":{"command":"RESTART","context":"RestartallcomponentsforYARN","operation_level":{"level":"SERVICE","cluster_name":"producer","service_name":"YARN"}},"Requests/resource_filters":[{"service_name":"YARN","component_name":"NODEMANAGER","hosts":"c0,c1,c2"},{"service_name":"YARN","component_name":"YARN_CLIENT","hosts":"c0,c1,c2,s0,s2,s3"},{"service_name":"YARN","component_name":"APP_TIMELINE_SERVER","hosts":"c1"},{"service_name":"YARN","component_name":"RESOURCEMANAGER","hosts":"c1,c2"},{"service_name":"YARN","component_name":"TIMELINE_READER","hosts":"c1"},{"service_name":"YARN","component_name":"YARN_REGISTRY_DNS","hosts":"c1"}]}'
restart_yarn_dingding.sh (发送钉钉消息,提醒已经重启)
curl 'https://oapi.dingtalk.com/robot/send?access_token=2c9115a39ee91850e95dcf1816bcac3dc990b6b253007b464a00deaf73adada1' \
-H 'Content-Type: application/json' \
-d '{"msgtype": "text",
"text": {
"content": "yarn restart To prevent errors,please check azkaban project and yarn application"
}
}'