ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: hadoop-yarn.cloudyhadoop.com:50010:DataXceiver error processing READ_BLOCK operation src: /192.168.1.104:52441 dst: /192.168.1.20:50010
修改数据传输线程个数
vi hdfs-site.xml
添加:复制到其它节点,并重启datanode。<property> <name>dfs.datanode.max.transfer.threads</name> <value>8192</value> <description> Specifies the maximum number of threads to use for transferring data in and out of the DN. </description> </property>