Hadoop
AaronLwx
这个作者很懒,什么都没留下…
展开
-
Hadoop使用lzo压缩并支持分片
[hadoop@hadoop004 hive-1.1.0-cdh5.7.0]$ which lzop/bin/lzop[hadoop@hadoop004 data]$ lzop -v page_views_big.dat[hadoop@hadoop004 data]$ ls -lahtotal 1.4Gdrwxrwxr-x 2 hadoop hadoop 4.0K Apr ...原创 2019-04-23 14:52:30 · 322 阅读 · 0 评论 -
HDFS架构设计
HDFS官网http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.6.0-cdh5.7.0/HDFS介绍The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware.HDFS is h...原创 2019-03-02 11:45:07 · 375 阅读 · 0 评论 -
Hadoop集群搭建
[root@hadoop001 ~]# useradd hadoop[root@hadoop002 ~]# useradd hadoop[root@hadoop003 ~]# useradd hadoop[root@hadoop001 ~]# su - hadoop[root@hadoop002 ~]# su - hadoop[root@hadoop003 ~]# su - ha...原创 2019-04-02 00:55:48 · 249 阅读 · 0 评论 -
Hdfs 故障恢复
下面以伪分布式为例来进行故障恢复。ok,let's go[hadoop@hadoop001 hadoop-2.6.0-cdh5.7.0]$ hdfs fsck /19/04/06 11:40:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using buil...原创 2019-04-07 22:14:34 · 1050 阅读 · 0 评论 -
铲掉Hadoop伪分布式集群重新再搭建
[root@hadoop004 tmp]# pwd/tmp[root@hadoop004 tmp]# lsAegis-<Guid(5A2C30A2-A87D-490A-9281-6765EDAD7CBA)>hadoop-hadoophadoop-hadoop-datanode.pidhadoop-hadoop-namenode.pidhadoop-hadoo...原创 2019-04-19 00:05:01 · 373 阅读 · 0 评论 -
Hadoop常用存储格式测试
hive> set hive.default.fileformat;hive.default.fileformat=TextFile先关闭压缩hive> SET hive.exec.compress.output > ;hive.exec.compress.output=truehive> > set hive.exec.co...原创 2019-04-19 15:49:54 · 403 阅读 · 0 评论