7 projects tagged "duplicate files"

Download Website Updated 13 Mar 2014 dedup.pl

Screenshot
Pop 86.67
Vit 1.87

dedup.pl is a script that scans Unix file systems and deletes duplicates files or creates hard links between duplicates, thereby freeing up disk space.

No download No website Updated 12 Feb 2012 image-deduplication-tool

Screenshot
Pop 40.73
Vit 28.94

image-deduplication-tool is a script designed to scan specified paths and calculate the DCT hashes of all the images there. It compares the hashes to find closest-looking image pairs, despite various alternations (such as crop, rotation, gamma/color correction, noise, etc.), optionally presenting them in a feh image viewer for the operator to easily compare and remove one of the versions. It uses libpHash to produce and compare perceptual hashes.

No download Website Updated 17 Jul 2011 fdupdirs

Screenshot
Pop 12.65
Vit 32.36

fdupdirs is a command line tool to find and delete duplicate and similar files and directories.

Download Website Updated 27 Nov 2010 FindDup

Screenshot
Pop 81.94
Vit 1.01

FindDup is an easy to use tool for detecting duplicate files on your computer.

Download Website Updated 08 Aug 2012 dupeGuru

Screenshot
Pop 173.12
Vit 6.04

dupeGuru is a tool for finding duplicate files on your computer. It can scan either filenames or contents. The filename scan features a fuzzy matching algorithm that can find duplicate filenames even when they are not exactly the same.

Download Website Updated 22 Jun 2009 HashCatalog

Screenshot
Pop 52.31
Vit 1.76

HashCatalog is a program that can find duplicate files in one or more folders or between two lists of one or more folders. HashCatalog supports a regular expression mask to select files to be evaluated for duplicates. HashCatalog will always recurse directories in search of files. HashCatalog can also create an XML file containing a listing of files, along with enough information to be able to determine duplicates. This XML file can be used to allow searches for duplicates against removable media. The catalog can be supplied to the list of search locations, along with individual files and folders. The hash methods supported are: MD5, SHA, SHA1, SHA256, SHA384, and SHA512.

Download Website Updated 04 Feb 2011 FreeDup

Screenshot
Pop 170.26
Vit 7.71

Freedup finds and eliminates duplicate files by linking them, and thus reduces the amount of used disk space within one or more file systems. By default, hardlinks are used on a single device, symbolic links when the devices differ. A set of options allows you to modify the methods of file comparison, the hash functions, the linking behavior, and the reporting style. You may use batch or interactive mode. Freedup usually only considers identical files, but when comparing audio or graphics files, you may elect to ignore the tags.

Screenshot

Project Spotlight

convertPgsSub

Conversion of pgs subtitles in mkv videos.

Screenshot

Project Spotlight

Pyinsane

A pure Python implementation of the Sane API and abstraction layer.