![](https://img-blog.csdnimg.cn/20201014180756916.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
Hadoop
文章平均质量分 78
github_28211665
这个作者很懒,什么都没留下…
展开
-
HDFS integration with Openstack Swift
The overall model in HDFS data flow with Openstack Swift integration. The works of HDFS and Openstack Swift have been done, refer to HADOOP-8545. It introduces an new concept in big data storage. An原创 2015-10-18 11:07:25 · 401 阅读 · 0 评论 -
Using Ambari Blueprint to Provision HDP automatically
Define the Blueprint { "configurations": [ { "hdfs-site": { "properties_attributes": { "final": { "dfs.namenode.htt原创 2015-10-12 16:23:38 · 580 阅读 · 0 评论 -
MapReduce處理檔案實驗(1) Avro
在 HDFS 上到底應該怎麼儲存才好呢?請看以下實驗。 本實驗主要介紹Hive處理Avro方法,與使用序列化儲存的好處,當然Avro的最重要功能Schema Evolution與Self-Describe目前還未想到好的例子說明,留到以後再提吧。 實驗數據是 HDFS 的日誌檔案,原始檔案存放於 Namenode 的宿主機檔案系統中,/var/log/hadoop/hdfs/hdfs-audi原创 2015-10-31 23:53:29 · 238 阅读 · 0 评论 -
Data Format: SquenceFiles
First we should understand what problems does the SequenceFile try to solve, and then how can SequenceFile help to solve the problems.In HDFS SequenceFile is one of the solutions to small file problem原创 2015-12-13 12:20:58 · 331 阅读 · 0 评论