linux虚拟机突然变成只读模式，任何文件都不能保存的问题解决

虚拟机用着用着，某一天突然文件系统大部分都变成只读了，真让人头疼

 -bash: cannot create temp file for here-document: Read-only file system

用 fsck 进行检查并修复、果然发现并修复了很多的问题。reboot 重启后一切问题都解决了。

root@hdp-01:~# fsck /
fsck from util-linux 2.31.1
e2fsck 1.44.1 (24-Mar-2018)
/dev/sda2 contains a file system with errors, check forced.
Pass 1: Checking inodes, blocks, and sizes
HTREE directory inode 1062887 has an invalid root node.
Clear HTree index<y>? yes
HTREE directory inode 1063356 has an invalid root node.
Clear HTree index<y>? yes
Deleted inode 1966091 has zero dtime.  Fix<y>? yes
Inodes that were part of a corrupted orphan linked list found.  Fix<y>? yes
Inode 1966092 was part of the orphaned inode list.  FIXED.
Inode 1966093 was part of the orphaned inode list.  FIXED.
Inode 1966094 was part of the orphaned inode list.  FIXED.
Inode 1966095 was part of the orphaned inode list.  FIXED.
Inode 1966161 was part of the orphaned inode list.  FIXED.
Pass 2: Checking directory structure
Directory inode 1063356, block #0, offset 0: directory corrupted
Salvage<y>? yes
Missing '.' in directory inode 1063356.
Fix<y>? yes
Setting filetype for entry '.' in ??? (1063356) to 2.
Missing '..' in directory inode 1063356.
Fix<y>? yes
Setting filetype for entry '..' in ??? (1063356) to 2.
Directory inode 1062887, block #0, offset 0: directory corrupted
Salvage<y>? yes
Missing '.' in directory inode 1062887.
Fix<y>? yes
Setting filetype for entry '.' in ??? (1062887) to 2.
Missing '..' in directory inode 1062887.
Fix<y>? yes
Setting filetype for entry '..' in ??? (1062887) to 2.
yEntry '-local-10025' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/??? (1316332) has deleted/unused inode 1316355.  Clear<y>? yes
Entry '-local-10026' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/??? (1316332) has deleted/unused inode 1316358.  Clear<y>? yes
Entry '-local-10019' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/??? (1316332) has deleted/unused inode 1316361.  Clear<y>? yes
Entry '-local-10027' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/??? (1316332) has deleted/unused inode 1316365.  Clear<y>? yes
Entry '-local-10028' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/??? (1316332) has deleted/unused inode 1316368.  Clear<y>? yes
Entry '-local-10021' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/??? (1316332) has deleted/unused inode 1316371.  Clear<y>? yes
Entry '-local-10013' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/??? (1316332) has deleted/unused inode 1317340.  Clear<y>? yes
Entry '-local-10039' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/??? (1316332) has deleted/unused inode 1318644.  Clear<y>? yes
Entry '-local-10040' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/??? (1316332) has deleted/unused inode 1318649.  Clear<y>? yes
Entry 'MapJoin-mapfile51--.hashtable' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/???/-local-10017/HashTable-Stage-19 (1316352) has deleted/unused inode 1316353.  Clear<y>? yes
Entry '.MapJoin-mapfile51--.hashtable.crc' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/???/-local-10017/HashTable-Stage-19 (1316352) has deleted/unused inode 1316354.  Clear<y>? yes
Entry 'Stage-19.tar.gz' in /usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/???/-local-10017/HashTable-Stage-19 (1316352) has deleted/unused inode 1316375.  Clear<y>? yes
Entry 'prelaunch.out' in /usr/local/hadoop/logs/userlogs/application_1555479214924_0004_DEL_1555484517438/container_1555479214924_0004_01_000002 (1318652) has deleted/unused inode 1318663.  Clear<y>? yes
Entry 'prelaunch.err' in /usr/local/hadoop/logs/userlogs/application_1555479214924_0004_DEL_1555484517438/container_1555479214924_0004_01_000002 (1318652) has deleted/unused inode 1318664.  Clear<y>? yes
Entry 'launch_container.sh' in /usr/local/hadoop/logs/userlogs/application_1555479214924_0004_DEL_1555484517438/container_1555479214924_0004_01_000002 (1318652) has deleted/unused inode 1319099.  Clear<y>? yes
Entry 'directory.info' in /usr/local/hadoop/logs/userlogs/application_1555479214924_0004_DEL_1555484517438/container_1555479214924_0004_01_000002 (1318652) has deleted/unused inode 1319100.  Clear<y>? yes
Entry 'stdout' in /usr/local/hadoop/logs/userlogs/application_1555479214924_0004_DEL_1555484517438/container_1555479214924_0004_01_000002 (1318652) has deleted/unused inode 1319101.  Clear<y>? yes
Entry 'stderr' in /usr/local/hadoop/logs/userlogs/application_1555479214924_0004_DEL_1555484517438/container_1555479214924_0004_01_000002 (1318652) has deleted/unused inode 1319102.  Clear<y>? yes
Entry 'syslog' in /usr/local/hadoop/logs/userlogs/application_1555479214924_0004_DEL_1555484517438/container_1555479214924_0004_01_000002 (1318652) has deleted/unused inode 1319103.  Clear<y>? yes
yDirectory inode 1063356, block #1, offset 0: directory corrupted
Salvage<y>? yes
Directory inode 1063356, block #2, offset 0: directory corrupted
Salvage<y>? yes
Directory inode 1063356, block #3, offset 0: directory corrupted
Salvage<y>? yes
Directory inode 1063356, block #4, offset 0: directory corrupted
Salvage<y>? yes
Directory inode 1062887, block #1, offset 0: directory corrupted
Salvage<y>? yes
Directory inode 1062887, block #2, offset 0: directory corrupted
Salvage<y>? yes
Directory inode 1062887, block #3, offset 0: directory corrupted
Salvage<y>? yes
Directory inode 1062887, block #4, offset 0: directory corrupted
Salvage<y>? yes
Pass 3: Checking directory connectivity
'..' in /usr/local/hadoop/data/data/current/BP-2022342345-192.168.253.139-1554972806867/current/finalized/subdir0/subdir9 (1062887) is <The NULL inode> (0), should be /usr/local/hadoop/data/data/current/BP-2022342345-192.168.253.139-1554972806867/current/finalized/subdir0 (1062950).
Fix<y>? yes
'..' in /usr/local/hadoop/data/data/current/BP-2022342345-192.168.253.139-1554972806867/current/finalized/subdir0/subdir8 (1063356) is <The NULL inode> (0), should be /usr/local/hadoop/data/data/current/BP-2022342345-192.168.253.139-1554972806867/current/finalized/subdir0 (1062950).
Fix<y>? yes
Unconnected directory inode 1316332 (/usr/local/hive/tmp/root/553326c9-80e4-4a81-96fb-057dc28a5068/???)
Connect to /lost+found<y>? yes
Pass 3A: Optimizing directories
Pass 4: Checking reference counts
Inode 2 ref count is 22, should be 24.  Fix<y>? yes
Unattached inode 1062758
Connect to /lost+found<y>? yes
Inode 1062758 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1062779
Connect to /lost+found<y>? yes
Inode 1062779 ref count is 2, should be 1.  Fix<y>? yes
Inode 1062950 ref count is 17, should be 15.  Fix<y>? yes
Unattached inode 1063237
Connect to /lost+found<y>? yes
Inode 1063237 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063238
Connect to /lost+found<y>? yes
Inode 1063238 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063241
Connect to /lost+found<y>? yes
Inode 1063241 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063242
Connect to /lost+found<y>? yes
Inode 1063242 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063247
Connect to /lost+found<y>? yes
Inode 1063247 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063248
Connect to /lost+found<y>? yes
Inode 1063248 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063249
Connect to /lost+found<y>? yes
Inode 1063249 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063250
Connect to /lost+found<y>? yes
Inode 1063250 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063251
Connect to /lost+found<y>? yes
Inode 1063251 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063252
Connect to /lost+found<y>? yes
Inode 1063252 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063362
Connect to /lost+found<y>? yes
Inode 1063362 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063363
Connect to /lost+found<y>? yes
Inode 1063363 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063364
Connect to /lost+found<y>? yes
Inode 1063364 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1063365
Connect to /lost+found<y>? yes
Inode 1063365 ref count is 2, should be 1.  Fix<y>? yes
Inode 1316332 ref count is 21, should be 11.  Fix<y>? yes
Unattached inode 1317699
Connect to /lost+found<y>? yes
Inode 1317699 ref count is 2, should be 1.  Fix<y>? yes
Unattached inode 1317700
Connect to /lost+found<y>? yes
Inode 1317700 ref count is 2, should be 1.  Fix<y>? yes
Pass 5: Checking group summary information
yBlock bitmap differences:  -(5251964--5251971) -5251989 -5251993 -5252490 -5252933 -(5394258--5394439) -(5394464--5394481) -5404555 -5423035 -(5455238--5455323) -(5484525--5484607) -5484709 -(5484752--5484789) -(7897472--7897493) -7904712 -(y7904721--7904734)
Fix<y>? yes
Free blocks count wrong for group #160 (23648, counted=23660).
Fix<y>? yes
Free blocks count wrong for group #164 (19815, counted=20016).
Fix<y>? yes
Free blocks count wrong for group #165 (32767, counted=32768).
Fix<y>? yes
Free blocks count wrong for group #166 (32583, counted=32669).
Fix<y>? yes
Free blocks count wrong for group #167 (32548, counted=32670).
Fix<y>? yes
Free blocks count wrong for group #241 (22877, counted=22914).
Fix<y>? yes
Free blocks count wrong (10657804, counted=10658263).
Fix<y>? yes
Inode bitmap differences:  -(1316353--1316375) -1316822 -1317340 -1317359 -1317388 -1317730 -1318644 -(1318647--1318651) -(1318663--1318664) -(1319099--1319103) -(1966091--1966095) -1966161
Fix<y>? yes
Free inodes count wrong for group #160 (2490, counted=2526).
Fix<y>? yes
Directories count wrong for group #160 (890, counted=878).
Fix<y>? yes
Free inodes count wrong for group #161 (8187, counted=8192).
Fix<y>? yes
Free inodes count wrong for group #240 (8100, counted=8106).
Fix<y>? yes
Free inodes count wrong (3131363, counted=3131410).
Fix<y>? yes

/dev/sda2: ***** FILE SYSTEM WAS MODIFIED *****
/dev/sda2: ***** REBOOT SYSTEM *****
/dev/sda2: 145390/3276800 files (0.2% non-contiguous), 2448169/13106432 blocks
root@hdp-01:~# fsck /
fsck from util-linux 2.31.1
e2fsck 1.44.1 (24-Mar-2018)
/dev/sda2: clean, 145390/3276800 files, 2448169/13106432 blocks
root@hdp-01:~# cd -bash: cannot create temp file for here-document: Read-only file system
root@hdp-01:~# fsck /
fsck from util-linux 2.31.1
e2fsck 1.44.1 (24-Mar-2018)
/dev/sda2: clean, 145390/3276800 files, 2448169/13106432 blocks

那么为什么变成只读模式呢？原来是前一天电脑突然意外关机了，而虚拟机中还正在运行着，导致了虚拟硬盘出现了文件紊乱。