【甘道夫】Apache Hadoop 2.5.0-cdh5.2.0 HDFS Quotas 配额控制

前言

HDFS为管理员提供了针对目录的配额控制特性，可以控制 名称配额（指定目录下的文件&文件夹总数），或者 空间配额（占用磁盘空间的上限）。

本文探究了HDFS的配额控制特性，记录了各类配额控制场景的实验详细过程。

实验环境基于Apache Hadoop 2.5.0-cdh5.2.0。

---

欢迎转载，请注明出处：http://blog.csdn.net/u010967382/article/details/44452485

---

名称配额功能试用

---

---

设置名称配额，即当前目录下文件和目录的最大数量：

casliyang@singlehadoop:~$   hdfs dfsadmin -setQuota 3 /Workspace/quotas/

15/03/18 14:53:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

上传文件：

casliyang@singlehadoop:~$  hdfs dfs -put slf4j-log4j12-1.6.4.jar /Workspace/quotas/

15/03/18 14:54:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

上传文件：

casliyang@singlehadoop:~$  hdfs dfs -put dict.txt /Workspace/quotas/

15/03/18 14:55:08 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

继续上传文件报错：

casliyang@singlehadoop:~$  hdfs dfs -put examples.desktop /Workspace/quotas/

15/03/18 14:55:28 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

put:  The NameSpace quota (directories and files) of directory /Workspace/quotas is exceeded:  quota=3 file count=4

查看该目录情况：

casliyang@singlehadoop:~$ hdfs dfs -ls /Workspace/quotas

15/03/18 17:11:31 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

Found 2 items

-rw-r--r--   3 casliyang supergroup         14 2015-03-18 14:55 /Workspace/quotas/dict.txt

-rw-r--r--   3 casliyang supergroup       9748 2015-03-18 14:38 /Workspace/quotas/slf4j-log4j12-1.6.4.jar