安装Hadoop
1.安装Hadoop 2.7.7版本
解压命令:tar -xzvf hadoop-2.7.7.tar.gz,比如安装到opt目录下
2.配置/etc/profile
在/etc/profile内配置Hadoop安装路径,在结尾加上下列内容
export HADOOP_HOME=/opt/hadoop-2.7.7
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
刷新配置文件:
root@instance-cqxyyrb2:/Hadoop/hadoop-2.7.7# source /etc/profile
3.修改hostname
查看本机ip:
root@instance-cqxyyrb2:/Hadoop/hadoop-2.7.7/etc/hadoop# ifconfig
eth0 Link encap:Ethernet HWaddr 00:16:3e:0c:2c:e8
inet addr:192.168.51.32 Bcast:192.168.51.1 Mask:255.255.2255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:711983 errors:0 dropped:0 overruns:0 frame:0
TX packets:595554 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:394480464 (394.4 MB) TX bytes:158758390 (158.7 MB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:1393574 errors:0 dropped:0 overruns:0 frame:0
TX packets:1393574 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1
RX bytes:121113970 (121.1 MB) TX bytes:121113970 (121.1 MB)
得到本机ip为192.168.51.32
配置/etc/hosts和/etc/hostname文件实现修改本机的hostname
将/etc/hosts内容修改为:
192.168.51.32 master
127.0.0.1 localhost localhost.localdomain
将/etc/hostname内容修改为:
master
保存后重启查看hostname:
root@master:~# hostname
master
可以看到hostname修改成功
3.配置ssh
进入~目录:
root@master:~# cd
生成ssh秘钥,输入ssh-keygen -t rsa后一直按enter:
root@master:~# ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa):
Created directory '/root/.ssh'.
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:8C72/b14V6HCPSIEVRIHEgHClWNeUZK3bB4KDpWGCLo root@master
The key's randomart image is:
+---[RSA 2048]----+
|o o.oo+*B*+o |
|.. o.B +o.o |
|. = + + . |
| . . o o * . |
|E o . S o . . .|
| . o o + + .|
| o . . o . .|
| . o . o. .|
| . ..o.oo |
+----[SHA256]-----+
授权:
root@master:~# cat .ssh/id_rsa.pub >> .ssh/authorized_keys
检验ssh:
[root@master ~]# ssh master
Last login: Thu Mar 14 11:45:09 2019 from master
[root@master ~]#
表示配置成功。
4.配置Hadoop配置文件
后面的配置请参考下面这篇文章,https://blog.csdn.net/hhy1107786871/article/details/85221665
安装和启动Hbase,
安装Hbase 2.0.4版本(不需要安装Zookeeper),Hbase自带了Zookeeper。
具体安装请参考这篇文章:
https://blog.csdn.net/hhy1107786871/article/details/88551234
这篇文章有几个地方没有描述清楚:1.不需要安装zookeeper2.SecondaryNameNode启动不了(可以忽略不计)
启动HBase进程只有下面几个节点
root@master:/HBase/conf# start-hbase.sh
running master, logging to /HBase/logs/hbase-root-master-master.out
root@master:/HBase/conf# jps
32995 Jps
32053 HQuorumPeer #hbase自带的zookeeper
29574 DataNode
29463 NameNode
29962 ResourceManager
32154 HMaster
30076 NodeManager
32268 HRegionServer
查看HBase是否正常,http://192.168.51.32:16010/master-status
安装Phoenix 5.0
下载apache-phoenix-5.0.0-HBase-2.0-bin.tar.gz
1.hbase和hadoop成功运行后,将
apache-phoenix-5.0.0-HBase-2.0-bin.tar.gz的两个jar包拷贝到hbase/lib目录
2.phoenix-5.0.0-HBase-2.0-bin.tar.gz解压后,使用,sqlline.py master命令进行登录
3.登录成功,即说明phoenix安装成功
安装squirelsql-4.1.0
第一,新增Driver
具体配置说明,见下图
第二,新增Alias
具体配置