Linux服务器服务不再产生日志排查

柔情只为你懂 2022-10-07 05:50 307阅读 0赞

首先

root@lyhcc:~# df -hi
    Filesystem     Inodes IUsed IFree IUse% Mounted on
    udev             466K   398  466K    1% /dev
    tmpfs            471K   962  470K    1% /run
    /dev/vda1        2.5M  2.5M     0  100% /
    tmpfs            471K     2  471K    1% /dev/shm
    tmpfs            471K     3  471K    1% /run/lock
    tmpfs            471K    16  471K    1% /sys/fs/cgroup
    tmpfs            471K     4  471K    1% /run/user/0

看到磁盘 /dev/vda1 占用满了

root@lyhcc:~# df -i
    Filesystem      Inodes   IUsed  IFree IUse% Mounted on
    udev            476845     398 476447    1% /dev
    tmpfs           481814     962 480852    1% /run
    /dev/vda1      2621440 2621440      0  100% /
    tmpfs           481814       2 481812    1% /dev/shm
    tmpfs           481814       3 481811    1% /run/lock
    tmpfs           481814      16 481798    1% /sys/fs/cgroup
    tmpfs           481814       4 481810    1% /run/user/0

看到inode满了，其实就是碎片log太多了

root@lyhcc:/# du -sh *
    1.5M	aaa.pdf
    52K	bbb.pdf
    13M	bin
    102M	boot
    11G	data
    0	dev
    27M	dh
    4.9M	etc
    520M	home
    0	initrd.img
    0	initrd.img.old
    711M	lib
    4.0K	lib64
    16K	lost+found
    12K	media
    4.0K	mnt
    438M	opt
    du: cannot access 'proc/22417/task/22417/fd/4': No such file or directory
    du: cannot access 'proc/22417/task/22417/fdinfo/4': No such file or directory
    du: cannot access 'proc/22417/fd/4': No such file or directory
    du: cannot access 'proc/22417/fdinfo/4': No such file or directory
    0	proc
    731M	root
    2.9M	run
    7.5M	sbin
    4.0K	srv
    0	sys
    395M	tmp
    1.8G	usr
    4.6G	var
    0	vmlinuz
    0	vmlinuz.old
    8.0K	WEB-INF

看到 /data的文件太多了

其实是这样

/data/applogs/xxl-job/jobhandler

xxljob的日志太多了

root@lyhcc:/data/applogs/xxl-job/jobhandler# rm -rf 2021-05-30/
    root@lyhcc:/data/applogs/xxl-job/jobhandler# rm -rf 2021-05-31/
    root@lyhcc:/data/applogs/xxl-job/jobhandler# rm -rf 2021-06-0*/
    root@lyhcc:/data/applogs/xxl-job/jobhandler# rm -rf 2021-06-10/
    root@lyhcc:/data/applogs/xxl-job/jobhandler# rm -rf 2021-06-11/
    root@lyhcc:/data/applogs/xxl-job/jobhandler# rm -rf 2021-06-12/
    root@lyhcc:/data/applogs/xxl-job/jobhandler# rm -rf 2021-06-13/
    root@lyhcc:/data/applogs/xxl-job/jobhandler# rm -rf 2021-06-14/

删除了xxljob的日志后

root@lyhcc:/opt/score/logs# df -i
    Filesystem      Inodes  IUsed   IFree IUse% Mounted on
    udev            476845    398  476447    1% /dev
    tmpfs           481814    962  480852    1% /run
    /dev/vda1      2621440 123087 2498353    5% /
    tmpfs           481814      2  481812    1% /dev/shm
    tmpfs           481814      3  481811    1% /run/lock
    tmpfs           481814     16  481798    1% /sys/fs/cgroup
    tmpfs           481814      4  481810    1% /run/user/0

空间释放了，ok了，可以重新启动你的服务了