Linux 下Hive 安装(Remote Metastore Database 单节点)

最新推荐文章于 2024-07-05 18:05:11 发布

A6-母婴小店-第6分店

最新推荐文章于 2024-07-05 18:05:11 发布

阅读量285

点赞数

分类专栏： HIVE 文章标签： hadoop

本文链接：https://blog.csdn.net/chooser007/article/details/117881180

版权

本文介绍了如何在Linux系统中安装Hive，包括配置Remote Metastore Database，使用MySQL作为元数据存储，并详细阐述了从安装MySQL到启动Hadoop集群，再到配置和测试Hive的过程。

摘要由CSDN通过智能技术生成

1、Linux下安装好mysql：Linux 下Mysql 安装

2、启动hadoop集群：

1、zk 启动
[root@node02 ~]# zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /opt/software/apache-zookeeper-3.6.2-bin/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED

2、HDFS启动：
[root@node01 ~]# start-all.sh 
This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
21/06/13 16:42:36 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [node01 node02]
node01: starting namenode, logging to /opt/software/hadoop-2.10.1/logs/hadoop-root-namenode-node01.out
node02: starting namenode, logging to /opt/software/hadoop-2.10.1/logs/hadoop-root-namenode-node02.out
node03: starting datanode, logging to /opt/software/hadoop-2.10.1/logs/hadoop-root-datanode-node03.out
node04: starting datanode, logging to /opt/software/hadoop-2.10.1/logs/hadoop-root-datanode-node04.out
node02: starting datanode, logging to /opt/software/hadoop-2.10.1/logs/hadoop-root-datanode-node02.out
Starting journal nodes [node01 node02 node03]
node01: starting journalnode, logging to /opt/software/hadoop-2.10.1/logs/hadoop-root-journalnode-node01.out
node03: starting journalnode, logging to /opt/software/hadoop-2.10.1/logs/hadoop-root-journalnode-node03.out
node02: starting journalnode, logging to /opt/software/hadoop-2.10.1/logs/hadoop-root-journalnode-node02.out
21/06/13 16:42:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting ZK Failover Controllers on NN hosts [node01 node02]
node01: starting zkfc, logging to /opt/software/hadoop-2.10.1/logs/hadoop-root-zkfc-node01.out
node02: starting zkfc, logging to /opt/software/hadoop-2.10.1/logs/hadoop-root-zkfc-node02.out
starting yarn daemons
starting resourcemanager, logging to /opt/software/hadoop-2.10.1/logs/yarn-root-resourcemanager-node01.out
node03: starting nodemanager, logging to /opt/software/hadoop-2.10.1/logs/yarn-root-nodemanager-node03.out
node04: starting nodemanager, logging to /opt/software/hadoop-2.10.1/logs/yarn-root-nodemanager-node04.out
node02: starting nodemanager, logging to /opt/software/hadoop-2.10.1/logs/yarn-root-nodemanager-node02.out

3、ResourceManager 启动：
[root@node03 ~]#  yarn-daemon.sh start resourcemanager
starting resourcemanager, logging to /opt/software/hadoop-2.10.1/logs/yarn-root-resourcemanager-node03.out
[root@node04 ~]# yarn-daemon.sh start resourcemanager
starting resourcemanager, logging to /opt/software/hadoop-2.10.1/logs/yarn-root-resourcemanager-node04.out

4、JPS 查看启动进程
[root@node01 ~]# jps
2009 DFSZKFailoverController
1852 JournalNode
1645 NameNode
2223 Jps
[root@node01 ~]# 
================