①Hive 搭建

前言

方便自己后面需要搭建的时候看看笔记就可以

准备工作

[root@node01 spark]# pwd #老规矩把安装包放在/try下
/try/flink
[root@node01 flink]# ll 
-rw-r--r--.  1 root root  255546057 Aug 18 03:56 flink-1.9.2-bin-scala_2.11.tgz

#添加阿里云yum源 参考https://wangairui.com/docs/npt/npt-1c3d2t86g9u4u
mv /etc/yum.repos.d/ /etc/yum.repos.d_bak
mkdir /etc/yum.repos.d/
cd /etc/yum.repos.d/
wget -O CentOs-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo
#yum源更新命令
yum clean all
yum makecache
yum update

#yum 安装mysql  参考 https://blog.csdn.net/u010798968/article/details/75212321
wget http://repo.mysql.com/mysql-community-release-el7-5.noarch.rpm
rpm -ivh mysql-community-release-el7-5.noarch.rpm
yum list | grep mysql
yum -y install mysql-server
#启动mysql

机器分布

xxx	node01	node02	node03
ZK	*	*	*
NameNode	*
SecondaryNameNode		*
DataNode		*	*
ResourceManager	*	*(需要手动启动)
NodeManager		*	*

环境变量

#在node01,node02,node03上都配置一下
export FLINK_HOME=/try/flink/flink-1.9.2

配置文件

1. slaves 配置文件

node02
node03

2. msters 配置文件

node01:8081
node02:8081

3. flink-conf.yaml 配置文件

jobmanager.rpc.port: 6123
jobmanager.heap.size: 1024m
taskmanager.heap.size: 1024m
taskmanager.numberOfTaskSlots: 2
parallelism.default: 1
high-availability: zookeeper
high-availability.storageDir: hdfs://node01:9001/flink/ha/
high-availability.zookeeper.quorum: node01:2181,node02:2181,node03:2181

4. 将整包发送到node02,node03

scp -r ./flink-1.9.2/ node02:`pwd`
scp -r ./flink-1.9.2/ node03:`pwd`

启动/关闭

web ui