虽然,hadoop1.x的版本不推荐使用append操作,但是系统中还是希望添加这样的功能,尝试了很多方法之后,最终在hadoop releasenotes中发现了可以给文件追加内容的方式
- HADOOP-8230. Major improvement reported by eli2 and fixed by eli
Enable sync by default and disable append
Append is not supported in Hadoop 1.x. Please upgrade to 2.x if you need append. If you enabled dfs.support.append for HBase, you're OK, as durable sync (why HBase required dfs.support.append) is now enabled by default. If you really need the previous functionality, to turn on the append functionality set the flag " dfs.support.broken.append" to true.
-
设置 dfs.support.broken.append为true即可完成追加操作。