- 博客(6)
- 收藏
- 关注
RSS订阅原创 Data Format: SquenceFiles
First we should understand what problems does the SequenceFile try to solve, and then how can SequenceFile help to solve the problems.In HDFS SequenceFile is one of the solutions to small file problem
2015-12-13 12:20:58
323
原创 MapReduce處理檔案實驗(1) Avro
在 HDFS 上到底應該怎麼儲存才好呢？請看以下實驗。 本實驗主要介紹Hive處理Avro方法，與使用序列化儲存的好處，當然Avro的最重要功能Schema Evolution與Self-Describe目前還未想到好的例子說明，留到以後再提吧。 實驗數據是 HDFS 的日誌檔案，原始檔案存放於 Namenode 的宿主機檔案系統中，/var/log/hadoop/hdfs/hdfs-audi
2015-10-31 23:53:29
234
原创 HDFS integration with Openstack Swift
The overall model in HDFS data flow with Openstack Swift integration. The works of HDFS and Openstack Swift have been done, refer to HADOOP-8545. It introduces an new concept in big data storage. An
2015-10-18 11:07:25
395
原创 Using Ambari Blueprint to Provision HDP automatically
Define the Blueprint { "configurations": [ { "hdfs-site": { "properties_attributes": { "final": { "dfs.namenode.htt
2015-10-12 16:23:38
571
原创 Privileged containers provisioning by Kubernetes in Ubuntu
I followed the official guide to install and setup Kubernetes 1.0-release on Ubuntu. Here is the way to provision a privileged container. Switch to the Ubuntu directory root@master: cd $KUBERNE
2015-10-06 03:49:04
676
原创 Docker awesome commands
Delete all the Exited Containers in One command sudo docker ps -a | grep Exit | cut -d ' ' -f 1 | xargs sudo docker rm
2015-09-23 21:49:08
333
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人