Hive Metastore Start 失败

最新推荐文章于 2024-05-02 21:39:35 发布
最新推荐文章于 2024-05-02 21:39:35 发布
阅读量1.4k 收藏
点赞数 1
分类专栏： ambari 文章标签： ambari
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/i54605/article/details/81912123
版权
使用 Ambari 安装 Hive 的时候，在启动 Hive Metastore 的时候报错
stderr: 
Python script has been killed due to timeout after waiting 1200 secs
 stdout:
2018-08-21 17:23:43,757 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634 -> 3.0.0.0-1634
2018-08-21 17:23:43,793 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf
2018-08-21 17:23:44,128 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634 -> 3.0.0.0-1634
2018-08-21 17:23:44,140 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf
2018-08-21 17:23:44,143 - Group['hdfs'] {}
2018-08-21 17:23:44,146 - Group['hadoop'] {}
2018-08-21 17:23:44,146 - Group['users'] {}
2018-08-21 17:23:44,147 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-21 17:23:44,149 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-21 17:23:44,150 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-21 17:23:44,152 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-21 17:23:44,153 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-21 17:23:44,155 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-21 17:23:44,156 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2018-08-21 17:23:44,158 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2018-08-21 17:23:44,159 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-21 17:23:44,161 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid': None}
2018-08-21 17:23:44,163 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-21 17:23:44,164 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-21 17:23:44,166 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2018-08-21 17:23:44,167 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2018-08-21 17:23:44,169 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2018-08-21 17:23:44,187 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if
2018-08-21 17:23:44,188 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2018-08-21 17:23:44,190 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2018-08-21 17:23:44,192 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2018-08-21 17:23:44,194 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {}
2018-08-21 17:23:44,216 - call returned (0, '1011')
2018-08-21 17:23:44,219 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1011'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2018-08-21 17:23:44,231 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1011'] due to not_if
2018-08-21 17:23:44,232 - Group['hdfs'] {}
2018-08-21 17:23:44,233 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop', u'hdfs']}
2018-08-21 17:23:44,234 - FS Type: HDFS
2018-08-21 17:23:44,234 - Directory['/etc/hadoop'] {'mode': 0755}
2018-08-21 17:23:44,267 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2018-08-21 17:23:44,269 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2018-08-21 17:23:44,299 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2018-08-21 17:23:44,316 - Skipping Execute[('setenforce', '0')] due to not_if
2018-08-21 17:23:44,317 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2018-08-21 17:23:44,324 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2018-08-21 17:23:44,325 - Directory['/var/run/hadoop/hdfs'] {'owner': 'hdfs', 'cd_access': 'a'}
2018-08-21 17:23:44,326 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
2018-08-21 17:23:44,338 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2018-08-21 17:23:44,342 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2018-08-21 17:23:44,353 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:44,376 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/hadoop-metrics2.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2018-08-21 17:23:44,377 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2018-08-21 17:23:44,379 - File['/usr/hdp/3.0.0.0-1634/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2018-08-21 17:23:44,387 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:44,399 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2018-08-21 17:23:44,408 - Skipping unlimited key JCE policy check and setup since the Java VM is not managed by Ambari
2018-08-21 17:23:44,889 - Using hadoop conf dir: /usr/hdp/3.0.0.0-1634/hadoop/conf
2018-08-21 17:23:44,911 - call['ambari-python-wrap /usr/bin/hdp-select status hive-server2'] {'timeout': 20}
2018-08-21 17:23:44,955 - call returned (0, 'hive-server2 - 3.0.0.0-1634')
2018-08-21 17:23:44,957 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.0.0-1634 -> 3.0.0.0-1634
2018-08-21 17:23:45,002 - File['/var/lib/ambari-agent/cred/lib/CredentialUtil.jar'] {'content': DownloadSource('http://ambari001:8080/resources/CredentialUtil.jar'), 'mode': 0755}
2018-08-21 17:23:45,005 - Not downloading the file from http://ambari001:8080/resources/CredentialUtil.jar, because /var/lib/ambari-agent/tmp/CredentialUtil.jar already exists
2018-08-21 17:23:46,525 - Yarn already refreshed
2018-08-21 17:23:46,526 - HdfsResource['/user/hive'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.0.0-1634/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://ambari002:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0755}
2018-08-21 17:23:46,531 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://ambari002:50070/webhdfs/v1/user/hive?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpmgkXQY 2>/tmp/tmp8HOxBD''] {'logoutput': None, 'quiet': False}
2018-08-21 17:23:46,674 - call returned (0, '')
2018-08-21 17:23:46,674 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":0,"fileId":17326,"group":"hdfs","length":0,"modificationTime":1534823601056,"owner":"hive","pathSuffix":"","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'')
2018-08-21 17:23:46,676 - HdfsResource['/warehouse/tablespace/external/hive'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.0.0-1634/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://ambari002:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hive', 'group': 'hadoop', 'hadoop_conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01777}
2018-08-21 17:23:46,679 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://ambari002:50070/webhdfs/v1/warehouse/tablespace/external/hive?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpyFHd3D 2>/tmp/tmpoGTDg7''] {'logoutput': None, 'quiet': False}
2018-08-21 17:23:46,787 - call returned (0, '')
2018-08-21 17:23:46,788 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"aclBit":true,"blockSize":0,"childrenNum":1,"fileId":17330,"group":"hadoop","length":0,"modificationTime":1534823698738,"owner":"hive","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'')
2018-08-21 17:23:46,789 - Skipping the operation for not managed DFS directory /warehouse/tablespace/external/hive since immutable_paths contains it.
2018-08-21 17:23:46,790 - HdfsResource['/warehouse/tablespace/managed/hive'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.0.0-1634/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://ambari002:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hive', 'group': 'hadoop', 'hadoop_conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0700}
2018-08-21 17:23:46,792 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://ambari002:50070/webhdfs/v1/warehouse/tablespace/managed/hive?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpzhJH0l 2>/tmp/tmpUJ3hZQ''] {'logoutput': None, 'quiet': False}
2018-08-21 17:23:46,900 - call returned (0, '')
2018-08-21 17:23:46,900 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"aclBit":true,"blockSize":0,"childrenNum":1,"fileId":17332,"group":"hadoop","length":0,"modificationTime":1534823699735,"owner":"hive","pathSuffix":"","permission":"700","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'')
2018-08-21 17:23:46,901 - Skipping the operation for not managed DFS directory /warehouse/tablespace/managed/hive since immutable_paths contains it.
2018-08-21 17:23:46,902 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'hdfs getconf -confKey dfs.namenode.acls.enabled 1>/tmp/tmpX69U3G 2>/tmp/tmpjY0m3b''] {'quiet': False}
2018-08-21 17:23:48,572 - call returned (0, '')
2018-08-21 17:23:48,573 - get_user_call_output returned (0, u'true', u'')
2018-08-21 17:23:48,574 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'hdfs getconf -confKey dfs.namenode.posix.acl.inheritance.enabled 1>/tmp/tmpr9ueOa 2>/tmp/tmp5y6M1M''] {'quiet': False}
2018-08-21 17:23:50,159 - call returned (0, '')
2018-08-21 17:23:50,159 - get_user_call_output returned (0, u'true', u'')
2018-08-21 17:23:50,160 - Execute['hdfs dfs -setfacl -m default:user:hive:rwx /warehouse/tablespace/external/hive'] {'user': 'hdfs'}
2018-08-21 17:23:53,559 - Execute['hdfs dfs -setfacl -m default:user:hive:rwx /warehouse/tablespace/managed/hive'] {'user': 'hdfs'}
2018-08-21 17:23:57,246 - HdfsResource[None] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.0.0-1634/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://ambari002:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'action': ['execute'], 'hadoop_conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp']}
2018-08-21 17:23:57,250 - Directories to fill with configs: [u'/usr/hdp/current/hive-metastore/conf', u'/usr/hdp/current/hive-metastore/conf/']
2018-08-21 17:23:57,252 - Directory['/etc/hive/3.0.0.0-1634/0'] {'owner': 'hive', 'group': 'hadoop', 'create_parents': True, 'mode': 0755}
2018-08-21 17:23:57,254 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hive/3.0.0.0-1634/0', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': ...}
2018-08-21 17:23:57,284 - Generating config: /etc/hive/3.0.0.0-1634/0/mapred-site.xml
2018-08-21 17:23:57,285 - File['/etc/hive/3.0.0.0-1634/0/mapred-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2018-08-21 17:23:57,368 - File['/etc/hive/3.0.0.0-1634/0/hive-default.xml.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,369 - File['/etc/hive/3.0.0.0-1634/0/hive-env.sh.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0755}
2018-08-21 17:23:57,375 - File['/etc/hive/3.0.0.0-1634/0/llap-daemon-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,381 - File['/etc/hive/3.0.0.0-1634/0/llap-cli-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,387 - File['/etc/hive/3.0.0.0-1634/0/hive-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,391 - File['/etc/hive/3.0.0.0-1634/0/hive-exec-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,395 - File['/etc/hive/3.0.0.0-1634/0/beeline-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,397 - XmlConfig['beeline-site.xml'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644, 'conf_dir': '/etc/hive/3.0.0.0-1634/0', 'configurations': {'beeline.hs2.jdbc.url.container': u'jdbc:hive2://ambari002:2181,ambari003:2181,ambari004:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2', 'beeline.hs2.jdbc.url.default': 'container'}}
2018-08-21 17:23:57,414 - Generating config: /etc/hive/3.0.0.0-1634/0/beeline-site.xml
2018-08-21 17:23:57,415 - File['/etc/hive/3.0.0.0-1634/0/beeline-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2018-08-21 17:23:57,420 - File['/etc/hive/3.0.0.0-1634/0/parquet-logging.properties'] {'content': ..., 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,422 - Directory['/etc/hive/3.0.0.0-1634/0'] {'owner': 'hive', 'group': 'hadoop', 'create_parents': True, 'mode': 0755}
2018-08-21 17:23:57,422 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hive/3.0.0.0-1634/0', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': ...}
2018-08-21 17:23:57,440 - Generating config: /etc/hive/3.0.0.0-1634/0/mapred-site.xml
2018-08-21 17:23:57,441 - File['/etc/hive/3.0.0.0-1634/0/mapred-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2018-08-21 17:23:57,526 - File['/etc/hive/3.0.0.0-1634/0/hive-default.xml.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,527 - File['/etc/hive/3.0.0.0-1634/0/hive-env.sh.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0755}
2018-08-21 17:23:57,534 - File['/etc/hive/3.0.0.0-1634/0/llap-daemon-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,539 - File['/etc/hive/3.0.0.0-1634/0/llap-cli-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,544 - File['/etc/hive/3.0.0.0-1634/0/hive-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,549 - File['/etc/hive/3.0.0.0-1634/0/hive-exec-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,552 - File['/etc/hive/3.0.0.0-1634/0/beeline-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,554 - XmlConfig['beeline-site.xml'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644, 'conf_dir': '/etc/hive/3.0.0.0-1634/0', 'configurations': {'beeline.hs2.jdbc.url.container': u'jdbc:hive2://ambari002:2181,ambari003:2181,ambari004:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2', 'beeline.hs2.jdbc.url.default': 'container'}}
2018-08-21 17:23:57,572 - Generating config: /etc/hive/3.0.0.0-1634/0/beeline-site.xml
2018-08-21 17:23:57,573 - File['/etc/hive/3.0.0.0-1634/0/beeline-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2018-08-21 17:23:57,578 - File['/etc/hive/3.0.0.0-1634/0/parquet-logging.properties'] {'content': ..., 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2018-08-21 17:23:57,579 - File['/usr/hdp/current/hive-metastore/conf/hive-site.jceks'] {'content': StaticFile('/var/lib/ambari-agent/cred/conf/hive_metastore/hive-site.jceks'), 'owner': 'hive', 'group': 'hadoop', 'mode': 0640}
2018-08-21 17:23:57,581 - Writing File['/usr/hdp/current/hive-metastore/conf/hive-site.jceks'] because contents don't match
2018-08-21 17:23:57,582 - XmlConfig['hive-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hive-metastore/conf/', 'mode': 0644, 'configuration_attributes': {u'hidden': {u'javax.jdo.option.ConnectionPassword': u'HIVE_CLIENT,CONFIG_DOWNLOAD'}}, 'owner': 'hive', 'configurations': ...}
2018-08-21 17:23:57,599 - Generating config: /usr/hdp/current/hive-metastore/conf/hive-site.xml
2018-08-21 17:23:57,600 - File['/usr/hdp/current/hive-metastore/conf/hive-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2018-08-21 17:23:57,891 - Writing File['/usr/hdp/current/hive-metastore/conf/hive-site.xml'] because contents don't match
2018-08-21 17:23:57,892 - Generating Atlas Hook config file /usr/hdp/current/hive-metastore/conf/atlas-application.properties
2018-08-21 17:23:57,893 - PropertiesFile['/usr/hdp/current/hive-metastore/conf/atlas-application.properties'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644, 'properties': ...}
2018-08-21 17:23:57,900 - Generating properties file: /usr/hdp/current/hive-metastore/conf/atlas-application.properties
2018-08-21 17:23:57,901 - File['/usr/hdp/current/hive-metastore/conf/atlas-application.properties'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2018-08-21 17:23:57,929 - Writing File['/usr/hdp/current/hive-metastore/conf/atlas-application.properties'] because contents don't match
2018-08-21 17:23:57,938 - File['/usr/hdp/current/hive-metastore/conf//hive-env.sh'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0755}
2018-08-21 17:23:57,939 - Writing File['/usr/hdp/current/hive-metastore/conf//hive-env.sh'] because contents don't match
2018-08-21 17:23:57,940 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'}
2018-08-21 17:23:57,945 - File['/etc/security/limits.d/hive.conf'] {'content': Template('hive.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644}
2018-08-21 17:23:57,947 - File['/usr/lib/ambari-agent/DBConnectionVerification.jar'] {'content': DownloadSource('http://ambari001:8080/resources/DBConnectionVerification.jar'), 'mode': 0644}
2018-08-21 17:23:57,948 - Not downloading the file from http://ambari001:8080/resources/DBConnectionVerification.jar, because /var/lib/ambari-agent/tmp/DBConnectionVerification.jar already exists
2018-08-21 17:23:57,948 - Directory['/var/run/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-08-21 17:23:57,950 - Directory['/var/log/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-08-21 17:23:57,951 - Directory['/var/lib/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2018-08-21 17:23:57,952 - XmlConfig['hivemetastore-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hive-metastore/conf/', 'mode': 0600, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': ...}
2018-08-21 17:23:57,971 - Generating config: /usr/hdp/current/hive-metastore/conf/hivemetastore-site.xml
2018-08-21 17:23:57,971 - File['/usr/hdp/current/hive-metastore/conf/hivemetastore-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0600, 'encoding': 'UTF-8'}
2018-08-21 17:23:57,994 - File['/usr/hdp/current/hive-metastore/conf/hadoop-metrics2-hivemetastore.properties'] {'content': Template('hadoop-metrics2-hivemetastore.properties.j2'), 'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2018-08-21 17:23:57,995 - File['/var/lib/ambari-agent/tmp/start_metastore_script'] {'content': StaticFile('startMetastore.sh'), 'mode': 0755}
2018-08-21 17:23:57,997 - HdfsResource[None] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.0.0-1634/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://ambari002:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'action': ['execute'], 'hadoop_conf_dir': '/usr/hdp/3.0.0.0-1634/hadoop/conf', 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp']}
2018-08-21 17:23:58,004 - Directory['/usr/lib/ambari-logsearch-logfeeder/conf'] {'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2018-08-21 17:23:58,005 - Generate Log Feeder config file: /usr/lib/ambari-logsearch-logfeeder/conf/input.config-hive.json
2018-08-21 17:23:58,005 - File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-hive.json'] {'content': Template('input.config-hive.json.j2'), 'mode': 0644}
2018-08-21 17:23:58,007 - Execute['export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/ ; /usr/hdp/current/hive-server2/bin/schematool -initSchema -dbType mysql -userName hive -passWord [PROTECTED] -verbose'] {'not_if': "ambari-sudo.sh su hive -l -s /bin/bash -c 'export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/ ; /usr/hdp/current/hive-server2/bin/schematool -info -dbType mysql -userName hive -passWord [PROTECTED] -verbose'", 'user': 'hive'}
2018-08-21 17:24:03,420 - Skipping Execute['export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/ ; /usr/hdp/current/hive-server2/bin/schematool -initSchema -dbType mysql -userName hive -passWord [PROTECTED] -verbose'] due to not_if
2018-08-21 17:24:03,422 - Execute['export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/ ; /usr/hdp/current/hive-server2/bin/schematool -initSchema -dbType hive -metaDbType mysql -userName hive -passWord [PROTECTED] -verbose'] {'not_if': u"ambari-sudo.sh su hive -l -s /bin/bash -c 'export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/ ; /usr/hdp/current/hive-server2/bin/schematool -info -dbType hive -metaDbType mysql -userName hive -passWord [PROTECTED] -verbose'", 'user': 'hive'}

Command failed after 1 tries

不知什么原因，这个问题在系统重启之后就自动解决

让梦想疯狂skey
关注
  • 1
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
ambari的安装以及集群部署
tf2333的博客
08-09 3837
最近在centos6.5上装ambari，并在上面部署Hadoop集群，其中的过程真是一段血泪史啊。 首先是安装ambari，http://www.ibm.com/developerworks/cn/opensource/os-cn-bigdata-ambari/ 这里有挺详细的解说，查看官网也有很详尽的步骤，一步步照做基本没什么问题。主要的问题出在了部署集群的confirm hosts 以及i
hive metastore java api使用
01-07
hive metastore hive metastore是hive的元数据管理服务，实际应用中很多第三方框架需要访问metastore服务，如spark,impala等。同样hive metastore也提供了java接口。 使用 import org.apache.hadoop.hive.conf....
Ambari配置&安装的若干坑
在路上的学习者
11-03 7957
centos6.5搭建过程可参考： （1）http://www.ibm.com/developerworks/cn/opensource/os-cn-bigdata-ambari/index.html （2）http://www.ibm.com/developerworks/cn/opensource/os-cn-bigdata-ambari2/index.html注意： （1）配置root用
hive启动一直失败 org.apache.hadoop.hive.metastore.HiveMetaException: Failed to load driver
热门推荐
一休求索
12-18 2万+
好不容把大数据集群装好了，但是hive始终启动不了。 第一步先认真的检查一下mysql中创建的hive数据和用户名 create database hive default charset utf8 collate utf8_general_ci; CREATE USER 'hive'@'%' IDENTIFIED BY 'Hive-123'; GRANT ALL PRIVILEGES ON hive.* TO 'hive'@'%'; FLUSH PRIVILEGES; 这个一定要增加，要不然本地
06 - metastore服务、hive服务启动脚本以及相关使用技巧
最新发布
花&败
05-02 1869
Hive的metastore服务的作用是为Hive CLI或者Hiveserver2提供元数据访问接口。metastore有两种运行模式，分别为嵌入式模式和。下面分别对两种模式进行说明：（1）嵌入式模式（2）独立服务模式生产环境中，不推荐使用嵌入式模式。因为其存在以下两个问题：（1）嵌入式模式下，每个Hive CLI都需要直接连接元数据库，当Hive CLI较多时，数据库压力会比较大。（2）每个客户端都需要用户元数据库的读写权限，元数据库的安全得不到很好的保证。
[ambari环境搭建]（未完待续）
weixin_30488313的博客
08-20 356
【安装】 https://blog.csdn.net/Happy_Sunshine_Boy/article/details/86595945#commentBox https://www.jianshu.com/p/f62947a88527 【卸载】 需要卸载干净才能进行安装，否则会出很多问题，卸载命令也可以写成shell脚本，这样效率较高。 https://www.cnblo...
Ambari【部署 01】最新版本ambari-2.7.7下载编译打包安装使用（踩坑实录）
Java与大数据相关实践内容分享！
04-19 4415
最新版本Ambari2.7.7从下载编译到放弃（编译坑太多及仅能管理CDH版本是原因）
详细调研hivemetastore管理机制.zip
09-22
《深入理解Hive Metastore管理机制》 在大数据处理领域，Hive作为一个基于Hadoop的数据仓库工具，因其易用性和高效性而被广泛应用。其中，Hive Metastore是Hive的核心组件之一，它负责管理和存储元数据，是理解和...
Hive metastore 使用达梦数据库存储元数据
05-10
《Hive metastore 使用达梦数据库存储元数据详解》 在大数据处理领域，Hive作为一个分布式数据仓库工具，被广泛用于存储和管理大规模结构化数据。Hive的元数据是其核心组成部分，它包含了表、分区、列等信息，使得...
hive-metastore-3.1.2.jar
04-15
hive-metastore-3.1.2.jar
standalone-hive-metastore
04-01
独立的Hive Metastore 该项目可在本地运行Hive Metastore，或将其嵌入到容器中。 尽管是公开的，但该项目目前尚未记录，并且可能仍承载某些基础结构特定配置。 该项目的灵感来自和多亏了他
Hive之MetaStore服务启动过程
weixin_33802505的博客
03-17 907
2019独角兽企业重金招聘Python工程师标准>>> ...
Ambari熟练应用篇
小强签名设计 的博客
08-22 1808
利用Ambari管理Hadoop集群 Service Level Action（服务级别的操作） 首先我们进到Ambari的GUI页面，并查看Dashboard。在左侧的Service列表中，我们可以点击任何一个您想要操作的Service。以MapReduce2为例（Hadoop这里的版本为 2.7.x，也就是YARN+HDFS+MapReduce2），当点击MapReduce2后，就会看
解决ambari平台hive进入卡住
汐银的博客
02-13 1385
在玩hive时遇到一个百思不解的问题在启动时总是卡住无法进入 查看日志也没有异常 最后解决方案 结束多余jps进程 然后重启ambari-agent就行了 
hive配置远程metastore的方法
03-28 4674
hive配置远程metastore的方法：     1）首先配置hive使用本地mysql存储metastore（服务器A 111.121.21.23）（也可以使用远程mysql存储）     2）配置完成后，在服务器A启动服务：/etc/init.d/hadoop-hive-metastore start  （默认监听端口是：9083）     3）配置hive客户端，修改
Hive安装配置指北（含Hive Metastore详解）
mojolang
05-06 1729
本文介绍Hive安装配置的整个过程，包括MySQL、Hive及Metastore的安装配置，并分析了Metastore三种配置方式的区别。网上有很多介绍Hive Metastore三种配置方式的文章，但是理解都不对，给读者造成了很多误导。本人详细阅读Apache和CDH官方文档中关于Hive Metastore的部分，并经过实践，终于填好各种坑，安装配置成功，遂记录下本文，供大家参考。 1.
hive启动命令
weixin_63001822的博客
05-26 2528
1、启动元数据管理服务（必须启动，否则无法工作）前台启动：bin/hive --service metastore后台启动：nohup bin/hive --service metastore >> logs/metastore.log 2>&1 &2、启动客户端Hive Shell方式（可以直接写SQL）： bin/hive。
Ambari安装之部署单节点集群
weixin_33910137的博客
03-27 433
                  前期博客 大数据领域两大最主流集群管理工具Ambari和Cloudera Manger Ambari架构原理 Ambari安装之Ambari安装前准备(CentOS6.5）（一） Ambari安装之部署本地库（镜像服务器）（二）         部署hdp单节点集群 （1）部署Agent 1) 注册并安装agent ht...
hive metastore mysql_Hive MetaStore的结构
06-13
Hive MetaStore是一个关系型数据库，用于存储Hive元数据，包括数据库、表、分区等信息。常见的Hive MetaStore数据库包括MySQL、PostgreSQL和Derby等。如果使用MySQL作为Hive MetaStore数据库，它的结构如下： 1. 数据库：默认名为metastore，默认字符集为UTF-8。 2. 表：存储Hive元数据的表有很多，包括TBLS、DBS、PARTITIONS等。其中，TBLS表存储表的基本信息，DBS表存储数据库的基本信息，PARTITIONS存储分区信息。 3. 列：每个表都有自己的列，这些列存储了表的各种属性，包括表名、列名、列数据类型、分区信息、表的所有者等。 4. 索引：Hive MetaStore数据库中的一些表会建立索引，以提高查询效率。例如，PARTITIONS表会建立基于分区键的索引。 总之，Hive MetaStore是一个非常重要的组件，它存储了Hive的元数据，对于Hive的正常运行非常关键。

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值