大数据单机环境搭建JDK,Hadoop(HDFS),Spark,Zookeeper,Kafka,

基本单机环境搭建

设置的虚拟机的IP

vi /etc/sysconfig/network-scripts/ifcfg-eth0

重启网络服务：service network restart

查看网卡的IP ： ifconfig

配置双网卡:192.168.18.163

桥接ms

#静态
DEVICE=eth0
TYPE=Ethernet
ONBOOT=yes
NM_CONTROLLED=yes
BOOTPROTO=static
DEFROUTE=yes
IPADDR=172.16.1.202
NETMASK=255.255.255.0
GETWAY=172.16.1.1
#动态
DEVICE=eth1
TYPE=Ethernet
ONBOOT=yes
NM_CONTROLLED=yes
BOOTPROTO=dhcp
DEFROUTE=yes

NETms

#静态
DEVICE=eth0
TYPE=Ethernet
ONBOOT=yes
BOOTPROTO=static
IPADDR=192.168.18.155
NETMASK=255.255.255.0
NM_CONTROLLED=yes
#动态
DEVICE=eth1
TYPE=Ethernet
ONBOOT=yes
BOOTPROTO=dhcp
NM_CONTROLLED=yes

关闭防火墙：service iptables stop

设置开机不启动防火墙：chkconfig iptables off

主机名和ip映射关系：

#最后一行加
vi /etc/hosts
192.168.18.163 CentOS007
#esc+:+x退出

ssh免密登陆

[root@CEntOS007 ~]# ssh-keygen -t rsa
[root@CEntOS007 ~]# ssh-copy-id CentOS007
The authenticity of host 'centos007 (192.168.18.163)' can't be established.
RSA key fingerprint is 26:2a:0a:7e:4f:47:40:cb:9b:94:59:7d:87:bc:73:78.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'centos007,192.168.18.163' (RSA) to the list of known hosts.
root@centos007's password:
Now try logging into the machine, with "ssh 'CentOS007'", and check in:

  .ssh/authorized_keys

to make sure we haven't added extra keys that you weren't expecting.

安装jdk

[root@CEntOS007 ~]# rpm -ivh jdk-8u191-linux-x64.rpm
warning: jdk-8u191-linux-x64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY
Preparing...                ########################################### [100%]
   1:jdk1.8                 ########################################### [100%]
Unpacking JAR files...
        tools.jar...
        plugin.jar