Linux – Server Frequently gets Read-Only File System

ext3filesystemslinuxread-only

This server has RAID-1 configured. It get readonly file system everyday. if i reboot it, it gets back with a read-write file system. but after a short while, readonly again…

Any idea please? Thanks. 

# dmesg |grep error
VFS: cannot write quota structure on device cciss/c0d0p8 (error -30). Quota may get out of sync!
VFS: cannot write quota structure on device cciss/c0d0p8 (error -30). Quota may get out of sync!
VFS: cannot write quota structure on device cciss/c0d0p8 (error -30). Quota may get out of sync!
VFS: cannot write quota structure on device cciss/c0d0p8 (error -30). Quota may get out of sync!
VFS: cannot write quota structure on device cciss/c0d0p8 (error -30). Quota may get out of sync!
VFS: cannot write quota structure on device cciss/c0d0p8 (error -30). Quota may get out of sync!
VFS: cannot write quota structure on device cciss/c0d0p8 (error -30). Quota may get out of sync!
VFS: cannot write quota structure on device cciss/c0d0p8 (error -30). Quota may get out of sync!
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71927230 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71927273 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71927333 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71927712 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71929238 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71929464 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71929704 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71929805 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71930367 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71931281 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71927230 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71927273 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71927333 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71927712 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71929238 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71929464 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71929704 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71929805 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71930367 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71931281 in dir #71927229
EXT3-fs error (device cciss/c0d0p8): ext3_lookup: unlinked inode 71927230 in dir #71927229

Best Answer

Looks like your disk needs a cleanup. You should force a fsck on it to clean up all these errors before it craps out on you totally.

There are a lot of switches available with fsck, but to get you started you can do one of the following:

This will check all mounts in your /etc/fstab file:

fsck -A

This will check the particular disk that is throwing those warnings:

fsck -t ext3 /dev/<device name>

You should be aware that an fsck can take a LONG time so this is not something you want to do in the middle of the day on a production server.

Related Topic