写的不到位的地方,欢迎评论指出不足之处
本人虚拟机环境部署
one | two | three | four | |
NameNode | yes | yes | ||
DataNode | yes | yes | yes | |
ZookepperFailoverController | yes | yes | ||
Zookepper | yes | yes | yes | |
NodeManage | yes | yes | yes | |
JournalNode | yes | yes | yes | |
ResourceManager | yes | yes | ||
Mysql | yes | |||
Hive MetaStoreServer | yes | |||
Hive Client | yes |
Remote Metastore Server
Server Configuration
Config Param | Config Value | Comment |
javax.jdo.option.ConnectionURL | jdbc:mysql://<host name>/<database name>?createDatabaseIfNotExist=true | mysql 连接 |
javax.jdo.option.ConnectionDriverName | com.mysql.jdbc.Driver | mysql 驱动 |
javax.jdo.option.ConnectionUserName | <username> | mysql 用户 |
javax.jdo.option.ConnectionPassword | <password> | mysql 密码 |
hive.metastore.warehouse.dir | <base hdfs path> | hdfs 上的数据存储目录 |
Client Configuration
Config Param | Config Value | Comment |
hive.metastore.warehouse.dir | <base hdfs path> | hdfs 上的数据存储目录 |
hive.metastore.uris | thrift://<host_name>:<port> | server 连接 |
Hive 安装配置
解压 hive 后配置环境变量
export HIVE_HOME=/opt/apache-hive-2.3.4-bin
export PATH=$PATH:${JAVA_HOME}/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$ZOOKEEPER_HOME/bin:$HIVE_HOME/bin
将 hive/conf/hive-default.xml.template 改名为 hive-site.xml
Server 节点上的 Hive 配置
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/var/hive/warehouse</value>
</property>
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://one:3306/hive?createDatabaseIfNotExist=true</value>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>123456</value>
</property>
Client 节点上的 Hive 配置
<property>
<name>hive.metastore.warehouse.dir</name>
<value>/var/hive/hive_remote/warehouse</value>
</property>
<property>
<name>hive.metastore.uris</name>
<value>thrift://three:9083</value>
</property>
Server 节点上的 Hive 启用