Save Hard Drive Space By Finding And Removing Duplicate Files

remove duplicate filesOf all the files that clutter our hard drives and take up valuable disk space, none are more useless than duplicate files. They’re worse than useless – taking up extra space in our backups and cluttering our file lists.

Duplicate files come in a variety of flavors. In addition to exact copies of files, you may have very similar images, music files that contain the same song ripped from different sources, or text documents that are almost the same but contain a few lines of unique text. These tools will help you remove duplicate files to whip your file collection into shape and free up valuable disk space.

dupeGuru

dupeGuru is an easy-to-use tool for finding duplicate files. It can check for duplicate files based on their file names or contents. Its “fuzzy matching algorithm” allows it to detect duplicate files when their file names or contents are similar, but not exactly the same.

dupeGuru is very simple to use – add one or more folders, click Scan, and it will tell you which files are duplicates. You can delete the files from within dupeGuru. While you can try dupeGuru for free, you’ll have to buy it if you want to delete more than ten files at a time.

remove duplicate files

dupeGuru is cross-platform. It works on Windows, Mac OS X, and Linux. For more information about dupeGuru, check out our full review.

Duplicate Music Files Finder

Duplicate Music Files Finder is focused only on music files. It works where other duplicate file finders won’t, by checking each MP3’s tags and comparing their song names. If you’ve ripped your own music from CDs or downloaded music from a variety of sources, you may have duplicate songs. If you ripped them with different quality settings, they won’t appear as duplicate files in most duplicate-finding programs – but they’re the same songs, nonetheless.

To enable this setting, click the Options button and select Use Tag Information after installing the program.

removing duplicate files

Add one or more folders and the application will show you which files have the same tags, even if they have different file names and sizes.

Duplicate Cleaner

Duplicate Cleaner is another powerful duplicate file-finder. While its free version lacks some of its more advanced options, it will still do a great job of finding duplicate and similar files on your hard drive. The selection assistant allows you to easily mark which files you want to delete, which is useful if you want to prefer the files in a specific folder.

removing duplicate files

For more information, check out our full review. While its interface has changed a bit, it still offers the same features.

WinMerge

WinMerge isn’t like other duplicate file-finding tools. It’s focused on locating and merging similar files. For example, you may have multiple copies of a text document, each with a few different lines. Maybe you edited them both and you aren’t sure which is the latest copy. Maybe each contains important information. If you don’t want to lose anything, WinMerge will give you a side-by-side look at the differences between the files and allow you to merge them.

When you use WinMerge, you choose a “left” folder and a “right” folder to compare. WinMerge works best if you have the files in different locations — for example, you may have a version of the file on your computer and another version on your USB drive.

In the screenshot below, WinMerge noticed that the file on the left contains a sentence that doesn’t appear in the file on the right. In some cases, both files will contain unique content, and you can merge them together into a single file.

remove duplicate files

For more information about WinMerge, check out our full review of WinMerge.

More Tools To Free Up Space

If you’re looking for more tools, check out 5 Ways To Find Duplicate Image Files On A Windows PC. If you want to free up more space on your hard drive, check out CCleaner, which deletes temporary files and other unimportant data. If you just want to see what’s eating up space on your hard drive, try WinDirStat.

How many duplicate files did you have lying around? Which duplicate file finder do you prefer? Leave a comment and let us know!

Image Credit: Magnifying Glass Over Documents via Shutterstock


MakeUseOf Recommends

Chris Hoffman

Chris Hoffman is a tech blogger and all-around technology addict living in Vancouver, BC. Connect with him on Google+ or Twitter.

The comments were closed because the article is more than 180 days old.

If you have any questions related to stuff mentioned in the article or need help with any computer issue, just ask it on MakeUseOf Answers.

Hide 31 Comments

  • Edwin Williams October 12, 2012
    0 likes

    Aye a good article! CCleaner works pretty well!

    | Like
    • Alan Wade October 22, 2012
      0 likes

      Does CCleaner search for duplicate files? I thought that it was and is a temp file cleaner.

      | Like
      • Chris Hoffman October 22, 2012
        0 likes

        It has some other tools, but I don’t think CCleaner has that feature.

        | Like
  • Jude A October 12, 2012
    0 likes

    Great article

    | Like
  • Jason Sager October 12, 2012
    0 likes

    Awesomesauce! I’ll definitely have to use this! :D

    | Like
  • Ugochukwu Mmaduekwe October 12, 2012
    0 likes

    Thanks for the tip.

    | Like
  • Ugochukwu Mmaduekwe October 12, 2012
    0 likes
    | Like
  • Yudono Ra October 13, 2012
    0 likes

    i like to use glaryutilities dupilicate finder :)

    | Like
  • Jorge G October 13, 2012
    0 likes

    I need a program that finds similar, not duplicate, video files. My porn collection is gettin way out of hand!

    | Like
  • Robert Ruedisueli October 13, 2012
    0 likes

    On music files, on desktops I keep one maximum compressed FLAC file of each one. This of course takes quite a while to make, but you only have to do it once and it saves a good 10% over standard FLAC compression.

    | Like
  • Robert Ruedisueli October 13, 2012
    0 likes

    For Linux:
    Tools that are good include

    Multifunction tools:
    fslint (Does duplicate files, temporary files, bad symlinks, empty directories, etc.)
    bleachbit (Clears cookies, cache, LSOs, thumbnails and other temporary files, allows you to wipe the data instead of just overwriting.)

    To see what is using space:
    Filelight (Displays the filesystem tree as a radial graph with wedges based on disk space used.)

    To compare and/or merge files
    kdiff3, fldiff (Graphics Mode)
    imediff (Terminal)
    hexdiff (Terminal, Hex Editor diff utility)

    | Like
  • Jacob Mathew October 13, 2012
    0 likes

    Thanks! This is good.

    | Like
  • Travis Kelm October 13, 2012
    0 likes

    I am always perplexed that CloneSpy never seems to show up in any duplicate finder round-up on the sites I frequent. I’ve used CloneSpy for many years now and find it to be the fastest dupe eliminator of any I’ve tested. It is 100% free as well.

    | Like
  • Mac Witty October 13, 2012
    0 likes

    I have been using Singlemizer from minimalisticdev.com for a long time and dupeGuru from hardcoded.net.
    Do also have a Gemeni licens (http://macpaw.com/) I don’t think I ever used – don’t know where I got i from, maybe a bundle

    | Like
  • Carl Jacob Saldi October 13, 2012
    0 likes

    this is awesome! thanks

    | Like
  • Dimal Chandrasiri October 13, 2012
    0 likes

    CClearner works well..

    | Like
  • Ah San October 13, 2012
    0 likes

    great tips for me to save hard drive space .

    | Like
  • Ah San October 13, 2012
    0 likes

    great tips for me to save hard drive space .

    | Like
  • Ah San October 13, 2012
    0 likes

    great tips for me to save hard drive space .

    | Like
  • Ying Yang October 13, 2012
    0 likes

    nice one!!

    | Like
  • Altra Attestor October 13, 2012
    0 likes

    thank you, very helpful

    | Like
  • Yiz Borol October 14, 2012
    0 likes

    Dupguru is my favorite duplicate file remover, I haven’t tried others but it’s interface is fantastic!

    | Like
    • Chris Hoffman October 22, 2012
      0 likes

      I really love Dupguru’s interface. So many of these utilities have frustrating interfaces.

      | Like
  • Lisa Santika Onggrid October 14, 2012
    0 likes

    Good article! Found a large number of duplicates when doing spring cleaning one year ago and now I’m doing monthly duplicate check. If your hard drive space ebbed mysteriously, try to check. You’ll be surprised when you found you’d accidentally copied a whole multimedia folder!

    | Like
  • Henry October 14, 2012
    0 likes

    In case you don’t have tags filled in your music files, you can use http://AudioComparer.com – this tool is able to detect duplicate songs by their actual sound!

    | Like
  • Max Smirnoff October 14, 2012
    0 likes

    Thanks! I am using Image Comparer and Audio Comparer tools – advanced duplicate finders for the photos and songs

    | Like
  • Paula Garland October 14, 2012
    0 likes

    Good article!

    | Like
  • Gail John October 19, 2012
    0 likes

    There were 45,152 duplicate files on my laptop. Thanks to Duplicate Cleaner, I was able to get rid of 43,494 of those files. Thumbs Up! to Duplicate Cleaner.

    | Like
  • Siddhant Chaurasia October 24, 2012
    0 likes

    That saved me 50GB of Hard Disk space

    | Like
  • Santosh Kolhar October 25, 2012
    0 likes

    Awesome.. thanks!!

    | Like
  • binary man March 13, 2013
    0 likes

    I use Directory Report to find duplicate files
    It can even find duplicate directories
    http://www.file-utilities.com

    | Like