HDFS-ShortCircuit(短回路)特性配置指南注意点
生产机器操作系统及库文件 版本–CentOS release 6.6【glibc-2.12】
新测试机器版本–CentOS Linux release 7.6.1810 (Core) 【glibc-2.17】
注意目录权限问题 hadoop:hadoop 755
2020-04-09 16:00:12,735 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Listening on UNIX domain socket: /hdfs-scc/hadoop-hdfs/dn_socket
测试:
[hadoop@xx /hdfs-scc/hadoop-hdfs]$ hdfs fsck //punch_batch_index -files -blocks
[hadoop@xx /hdfs-scc/hadoop-hdfs]$ hadoop fs -get //punch_batch_index /tmp
2020-04-09 16:08:34,615 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: cliID: DFSClient_NONMAPREDUCE_-581350819_1, src: 127.0.0.1, dest: 127.0.0.1, op: REQUEST_SHORT_CIRCUIT_SHM, shmId: 3e91c617db1b8d9828d4a1fe007f0214, srvID: 8cee4702-8b9f-49db-8202-78a9fe789912, success: true
2020-04-09 16:08:34,658 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: 127.0.0.1, dest: 127.0.0.1, op: REQUEST_SHORT_CIRCUIT_FDS, blockid: 1074790321, srvID: 8cee4702-8b9f-49db-8202-78a9fe789912, success: true