平台搭建

1.
put: File /usr/xhj/电话调查.zip._COPYING_ could only be replicated to 0 nodes instead of minReplication (=1).  There are 0 datanode(s) running and no node(s) are excluded in this operation.
关掉防火墙：sudo ufw disable
scp
hadoop fs -put 电话调查.zip /usr/xhj/
/usr/hadoop/hadoop-2.7.3/sbin ./stop-

2
/usr/hadoop/hadoop-2.7.3/bin
压缩包建立
hndx@server235:/usr/hadoop/hadoop-2.7.3/etc$ tar -cvf -hadoop | gzip > temp.tar.gz
比如生成的文件是file.tar.gz 你要打包的文件夹是/home/test/下的所有文件，命令如下（最后的星号不要忘记哦）。 tar -cvzf file.tar.gz /home/test/*

http://my.csdn.net/my/album/detail/1829195点击打开链接

 配置
3
问题error 处理DataNode节点为0，使得live node变为3
http://blog.csdn.net/Meoop/article/details/50806724   
jdk，jps

4清空
$ sudo rm -f *
$ sudo rm -rf *
显示如图

 解压hndx@server235:/usr/wenjian$ ls
电话调查.tar.gz
hndx@server235:/usr/wenjian$ sudo tar zxvf 电话调查.tar.gz 
移除集群文件
hndx@server235:/usr/wenjian$ hadoop fs -rm -r /usr
17/01/18 09:36:39 INFO fs.TrashPolicyDefault: Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
启动安全
/hadoop dfsadmin -safemode leave

点击打开链接

配置文件：

hndx@server235:/usr/hadoop/hadoop-2.7.3/etc$ cd hadoop/

hndx@server235:/usr/hadoop/hadoop-2.7.3/etc/hadoop$ ls

hndx@server235:/usr/hadoop/hadoop-2.7.3/etc/hadoop$ cat hdfs-site.xml

hndx@server235:/usr/hadoop/hadoop-2.7.3/etc/hadoop$ cat slaves

hndx@server235:/usr/hadoop/hadoop-2.7.3/etc/hadoop$ cat mapred-site.xml.template

2017年1月15日 #数据库配置

#数据库配置javax.jdo.option.ConnectionURL

 

jdbc:mysql://134.160.xxx.xxx:3306/hive?characterEncoding=UTF8&useSSL=false&createDatabaseIFNotExist=true

scratch配置

<name>hive.exec.scratchdir</name>

    <value>/home/hive/apache-hive-2.1.1-bin/scratchdir/tmp</value>

 

元数据

<value>/home/hive/apache-hive-2.1.1-bin/warehouse/home</value>