Hadoop集群去掉机器后处理

10台的集群测试环境，去掉3台后。.

....
/user/root/temp/mr/partitions_f02eee55-88c3-4fae-befe-2f2a0c83ebe1: CORRUPT block blk_-8923256526393873848

/user/root/temp/mr/partitions_f02eee55-88c3-4fae-befe-2f2a0c83ebe1: MISSING 1 blocks of total size 153 B..Status: CORRUPT
 Total size:    2614389900794 B (Total open files size: 1782733 B)
 Total dirs:    36849
 Total files:   17637 (Files currently being written: 12)
 Total blocks (validated):    54612 (avg. block size 47872077 B) (Total open file blocks (not validated): 12)
  ********************************
  CORRUPT FILES:        170
  MISSING BLOCKS:       588
  MISSING SIZE:         35257196484 B
  CORRUPT BLOCKS:       588
  ********************************
 Minimally replicated blocks: 54024 (98.92332 %)
 Over-replicated blocks:      0 (0.0 %)
 Under-replicated blocks:     17523 (32.086353 %)
 Mis-replicated blocks:       0 (0.0 %)
 Default replication factor:  2
 Average block replication:   2.3262653
 Corrupt blocks:              588
 Missing replicas:            20775 (16.35286 %)
 Number of data-nodes:        5
 Number of racks:             1
FSCK ended at Thu Jun 19 17:29:34 CST 2014 in 12562 milliseconds

The filesystem under path '/' is CORRUPT

又启动了一台后

.Status: CORRUPT
 Total size:    2614389900794 B (Total open files size: 1782733 B)
 Total dirs:    36849
 Total files:   17637 (Files currently being written: 12)
 Total blocks (validated):      54612 (avg. block size 47872077 B) (Total open file blocks (not validated): 12)
  ********************************
  CORRUPT FILES:        116
  MISSING BLOCKS:       364
  MISSING SIZE:         22376610846 B
  CORRUPT BLOCKS:       364
  ********************************
 Minimally replicated blocks:   54248 (99.33348 %)
 Over-replicated blocks:        14488 (26.528969 %)
 Under-replicated blocks:       11478 (21.017359 %)
 Mis-replicated blocks:         0 (0.0 %)
 Default replication factor:    2
 Average block replication:     2.7334104
 Corrupt blocks:                364
 Missing replicas:              13476 (9.027513 %)
 Number of data-nodes:          6
 Number of racks:               1
FSCK ended at Fri Jun 20 15:28:28 CST 2014 in 21481 milliseconds

The filesystem under path '/' is CORRUPT

安全模式已打开。现在关闭安全模式，并修复hdfs系统

bin/hadoop dfsadmin -safemode leave

bin/hadoop fsck -delete

bin/haoop fsck /

/user/root/temp/mr/partitions_cc73ffc2-dfd1-4831-97ab-2d523ba2d8ef:  Under replicated blk_1194688287120490740_636420. Target Replicas is 2 but found 1 replica(s).
........Status: HEALTHY
 Total size:    2039909061423 B (Total open files size: 1782733 B)
 Total dirs:    36849
 Total files:   17521 (Files currently being written: 12)
 Total blocks (validated):      45972 (avg. block size 44372858 B) (Total open file blocks (not validated): 12)
 Minimally replicated blocks:   45972 (100.0 %)
 Over-replicated blocks:        12377 (26.922909 %)
 Under-replicated blocks:       9186 (19.981728 %)
 Mis-replicated blocks:         0 (0.0 %)
 Default replication factor:    2
 Average block replication:     2.8938484
 Corrupt blocks:                0
 Missing replicas:              11054 (8.30903 %)
 Number of data-nodes:          6
 Number of racks:               1
FSCK ended at Fri Jun 20 15:38:31 CST 2014 in 16376 milliseconds

The filesystem under path '/' is HEALTHY