[ubuntu-za] Out of Space

Anton May antonmay at gmail.com
Sun Aug 28 09:36:26 UTC 2016


Feel like a real tw at t. The /4TB never mounted properly so it filled the /
dir instead. Crises averted.

On 28 August 2016 at 10:32, Frans de waal <meesterarend at gmail.com> wrote:

> Another thought what is directly in the root folder it seems like you are
> missing som gigs of data there that does not add up
>
> On 28 Aug 2016 10:27, "Frans de waal" <meesterarend at gmail.com> wrote:
>
> On 28 Aug 2016 09:45, "Anton May" <antonmay at gmail.com> wrote:
> >
> > Howzit all
> >
> > Need some assistance please regarding space.
> >
> > I'm out of space on the / dir of the archive server. The / dir is only
> normal system and home files. The MySQL data is on another HDD partition.
> >
> > This is the out put of df -h
> >
> > root at archive-dr:~# df -h
> > Filesystem      Size  Used Avail Use% Mounted on
> > udev            3,9G  4,0K  3,9G   1% /dev
> > tmpfs           798M  552K  797M   1% /run
> > /dev/dm-0       260G  259G     0 100% /
> > none            4,0K     0  4,0K   0% /sys/fs/cgroup
> > none            5,0M     0  5,0M   0% /run/lock
> > none            3,9G     0  3,9G   0% /run/shm
> > none            100M     0  100M   0% /run/user
> > /dev/sda1       236M   69M  156M  31% /boot
> > /dev/sdf1       2,2T  1,9T  207G  91% /batches
> > overflow        1,0M     0  1,0M   0% /tmp
> > /dev/sdb1       3,6T  1,6T  1,9T  46% /4TB
> > /dev/sde1       2,7T  2,2T  384G  86% /archive
> >
> > The /tmp dir is now also mounted in overflow
> >
> > This is the out put of du -sh /*
> >
> > root at archive-dr:~# du -sh /*
> > 1,6T /4TB
> > 2,2T /archive
> > 1,9T /batches
> > 9,6M /bin
> > 67M /boot
> > 4,0K /dev
> > 5,2M /etc
> > 32K /home
> > 0 /initrd.img
> > 0 /initrd.img.old
> > 520M /lib
> > 4,0K /lib64
> > 16K /lost+found
> > 8,0K /media
> > 8,0K /mnt
> > 298M /opt
> > du: cannot access ‘/proc/3156/task/3156/fd/4’: No such file or directory
> > du: cannot access ‘/proc/3156/task/3156/fdinfo/4’: No such file or
> directory
> > du: cannot access ‘/proc/3156/fd/4’: No such file or directory
> > du: cannot access ‘/proc/3156/fdinfo/4’: No such file or directory
> > 0 /proc
> > 41M /root
> > 552K /run
> > 12M /sbin
> > 4,0K /srv
> > 0 /sys
> > 0 /tmproot at archive-dr:~# du -sh /*
> > 1,6T /4TB
> > 2,2T /archive
> > 1,9T /batches
> > 9,6M /bin
> > 67M /boot
> > 4,0K /dev
> > 5,2M /etc
> > 32K /home
> > 0 /initrd.img
> > 0 /initrd.img.old
> > 520M /lib
> > 4,0K /lib64
> > 16K /lost+found
> > 8,0K /media
> > 8,0K /mnt
> > 809M /usr
> > 445M /var
> > 0 /vmlinuz
> >
> > The out put of lsof
> >
> > root at archive-dr:~# lsof | grep "deleted"
> > mysqld    1637           mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637           mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637           mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637           mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637           mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1638      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1638      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1638      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1638      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1638      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1639      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1639      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1639      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1639      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1639      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1640      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1640      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1640      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1640      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1640      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1641      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1641      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1641      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1641      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1641      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1642      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1642      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1642      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1642      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1642      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1643      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1643      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1643      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1643      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1643      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1644      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1644      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1644      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1644      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1644      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1645      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1645      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1645      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1645      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1645      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1646      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1646      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1646      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1646      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1646      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1647      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1647      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1647      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1647      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1647      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 1648      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 1648      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 1648      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 1648      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 1648      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2205      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2205      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2205      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2205      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2205      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2206      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2206      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2206      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2206      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2206      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2207      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2207      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2207      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2207      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2207      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2208      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2208      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2208      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2208      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2208      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2209      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2209      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2209      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2209      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2209      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2210      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2210      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2210      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2210      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2210      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2211      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2211      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2211      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2211      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2211      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2212      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2212      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2212      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2212      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2212      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2213      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2213      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2213      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2213      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2213      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2214      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2214      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2214      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2214      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2214      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2215      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2215      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2215      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2215      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2215      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2218      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2218      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2218      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2218      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2218      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2220      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2220      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2220      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2220      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2220      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> > mysqld    1637 2896      mysql    4u      REG               0,23
>    0      11361 /tmp/ibG0k4BD (deleted)
> > mysqld    1637 2896      mysql    5u      REG               0,23
>    0      11362 /tmp/ib2QXicc (deleted)
> > mysqld    1637 2896      mysql    6u      REG               0,23
>    0      11363 /tmp/ibCeGxMK (deleted)
> > mysqld    1637 2896      mysql    7u      REG               0,23
>    0      11377 /tmp/ibOyDdhS (deleted)
> > mysqld    1637 2896      mysql   15u      REG               0,23
>    0      13385 /tmp/ibIeT1S7 (deleted)
> >
> > &
> >
> > root at archive-dr:~# find /proc/*/fd -ls 2> /dev/null | grep '(deleted)'
> > 110764    0 lrwx------   1 root     root           64 Aug 28 09:11
> /proc/1637/fd/4 -> /tmp/ibG0k4BD\ (deleted)
> > 110765    0 lrwx------   1 root     root           64 Aug 28 09:11
> /proc/1637/fd/5 -> /tmp/ib2QXicc\ (deleted)
> > 110766    0 lrwx------   1 root     root           64 Aug 28 09:11
> /proc/1637/fd/6 -> /tmp/ibCeGxMK\ (deleted)
> > 110767    0 lrwx------   1 root     root           64 Aug 28 09:11
> /proc/1637/fd/7 -> /tmp/ibOyDdhS\ (deleted)
> > 110775    0 lrwx------   1 root     root           64 Aug 28 09:11
> /proc/1637/fd/15 -> /tmp/ibIeT1S7\ (deleted)
> >
> > Don't know what I'm missing here, anybody out there can help a bit?
> > --
> > Regards,
> > Anton May
> >
> > --
> > ubuntu-za mailing list
> > ubuntu-za at lists.ubuntu.com
> > https://lists.ubuntu.com/mailman/listinfo/ubuntu-za
> >
> Wher is dev/dm-0 mounted?  Maybe trace that....  Also one of the fitst
> places i clean is /var/log as it's usually the culprit with me
>
>
>
> --
> ubuntu-za mailing list
> ubuntu-za at lists.ubuntu.com
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-za
>
>


-- 
Regards,
Anton May
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/ubuntu-za/attachments/20160828/f3290e85/attachment-0001.html>


More information about the ubuntu-za mailing list