[Ubuntu-eg] how can i find duplicate files, folders ?

Ahmed Kamal email.ahmedkamal at googlemail.com
Tue Nov 8 20:46:50 UTC 2011


If you wanna code it for fun, enjoy. However if you want it to solve a
real-life problem, here is a simple one liner that may help

$ find . -exec md5sum {} \; 2>/dev/null | sort | tee md5.log | uniq -c -w
32 -d

This will print <repeat-count> <md5sum> <file-name>
Example:

      2 45d8a687baba5945db31936c171f49ed  ./HPIM1910.JPG

If you'd like to know what other files are duplicates of that file .. just
grep the checksum like

$ grep 45d8a687baba5945db31936c171f49ed md5.log
45d8a687baba5945db31936c171f49ed  ./HPIM1910.JPG
45d8a687baba5945db31936c171f49ed  ./koko.JPG

PS: Since checksumming files is not a fast process, storing results in that
log file is actually a good thing.
If you need more advanced options, check this list out:
http://en.wikipedia.org/wiki/Fdupes

Happy Eid :)

On Tue, Nov 8, 2011 at 9:35 PM, Anas Emad <anas.emad at gmail.com> wrote:

> hi team
>
> if there simple tool or app for help me to find and delete duplicated
> files and folders ?
>
> what about create simple one for us ?
>
>
>    - just search and compare file name + file size + file type
>    - search and compare folder name + folder contain
>    - type results
>    - sort results by older
>    - sort results by bigger size
>    - check files,delete
>    - merge folders
>
> what about code it paython ? ruby in rails ? java ?
>
> and run it on ubuntu, win, mac
>
> i need simple tool
>
>
> ______________________________________________________________________________
> *
> Anas Emad *
> *Call me: +2 0144 27 49 47*
>
> http://about.me/anas.emad
>
> FaceBook <http://www.facebook.com/anas.emad> - Twitter<https://twitter.com/#%21/anaas>
>
> <anas.emad at gmail.com>4Chat : islamicboy_ at hotmail.com
>          anas_emad1987 at yahoo.com
> 4Skype: anas.emad
>
>
> --
> Ubuntu-eg mailing list
> Ubuntu-eg at lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-eg
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ubuntu.com/archives/ubuntu-eg/attachments/20111108/2957e86d/attachment.html>


More information about the Ubuntu-eg mailing list