Latest or all posts or last 15, 30, 90 or 180 days.
Welcome to diglloyd.com
In-depth review coverage is by subscription.
Also by Lloyd: MacPerformanceGuide.com and WindInMyFace.com
First-time visitor
Up to 1527MB/s sustained performance

diglloydTools IntegrityChecker Java Version: Finds Duplicates, Saved me 100GB!

diglloydTools

A cool new feature of diglloydTools IntegrityChecker 'icj' (Java version) is finding duplicate files; it saved me a whopping 100GB! Over the past few years, I had inadvertantly made copies when intending to move files due to a silent Finder bug: if files are marked as locked, the Finder makes copies—yikes!

By using the SHA-1 hashes, exact matches can be found unerringly and all but instantly (once the hashes are done via the 'update' command).

This example is after the 100GB duplications were found and deleted, so there is only 2.4 GiB left of duplicates.

Note: this listing is not displayed fully or properly due to bugs in web browsers.

# find all duplicates on volume Archive
diglloydMP:DIGLLOYD lloyd$ icj dupes Archive
# icj version 1.0 beta 5 @ 2016-08-13 17:38
# Copyright 2016 DIGLLOYD INC. All Rights Reserved
# Use of this software requires a license. https://macperformanceguide.com/Software-License.html
# Sat Aug 13 20:33:49 PDT 2016
[1]={/Volumes/Archive}
Finding folders...4240.6920.9043.12381.14350.16676.16676 12003 ms to find 16676 folders
Loading hash data concurrently for 16676 folders... 0.100.200.300.400.500.600.700.800.900.1000.1100.1200....16500.16600....waiting for I/O to finish...15652.16676 Loaded hash data for 16676 folders in 23822 ms

995 ms to find duplicates

1 duplicate of "/Volumes/Archive/WebSiteOriginals/Infrared-S3-D70-5D/2006-0829-IR-camera-compare-all-orig/S3/091/DSCF0472.RAF" waste = 24 MiB
/Volumes/Archive/WebSiteOriginals/Infrared-S3-D70-5D/2006-0829-IR-camera-compare/S3/091/DSCF0472.RAF
1 duplicate of "/Volumes/Archive/ArticlesAndReviews/D2XColor/materials/2005-0423 ManyTests/1/color-balance-correction/LCDPhotos/IMG_0044.JPG" waste = 1644 KiB
/Volumes/Archive/ArticlesAndReviews/D2XColor/LCDPhotos/IMG_0044.JPG

... lines omitted for brevity ...

4 duplicates of "/Volumes/Archive/ArticlesAndReviews/D2X-vs-1DsMII/publish/logos/diglloyd36.gif" waste = 2644 bytes
/Volumes/Archive/ArticlesAndReviews/ShiftLensStitching/publish/logos/diglloyd36.gif
/Volumes/Archive/ArticlesAndReviews/D200-vs-D2X/publish/logos/diglloyd36.gif
/Volumes/Archive/ArticlesAndReviews/TheSharpestImage/original/publish/logos/diglloyd36.gif
/Volumes/Archive/ArticlesAndReviews/CoastalOptics60f4/CoastalOptics_60f4/publish/logos/diglloyd36.gif 1 duplicate of "/Volumes/Archive/WebSiteOriginals/Infrared-S3-D70-5D/2006-0829-IR-camera-compare/D70/no-filter/_DSC5742.xmp" waste = 4380 bytes
/Volumes/Archive/WebSiteOriginals/Infrared-S3-D70-5D/2006-0829-IR-camera-compare-all-orig/D70/no-filter/_DSC5742.xmp
....

WASTED SPACE from duplicate files: 2388 MiB
B&H Deal ZoneDeals by Brand/Category/Savings
Deals expire in 12 hours unless noted. Certain deals may last longer.
$1199 SAVE $500 = 29.0% $19 FREE ITEMS Canon 18x50 IS Image Stabilized Binocular in All Other Categories
$1049 SAVE $450 = 30.0% $20 FREE ITEMS Canon EOS 77D DSLR with 18-135mm USM in Cameras: DSLR
$65 SAVE $25 = 27.0% $19 FREE ITEMS Celestron 15x70 SkyMaster Binocular in All Other Categories
$1697 SAVE $300 = 15.0% Nikon D750 DSLR in Cameras: DSLR
$2197 SAVE $900 = 29.0% Nikon D750 DSLR with 24-120mm in Cameras: DSLR
$3297 SAVE $800 = 19.0% Nikon D810 DSLR with 24-120mm in Cameras: DSLR
$300 SAVE $160 = 34.0% $9 FREE ITEMS Steiner 8x32 XC Binocular in All Other Categories
$1099 SAVE $200 = 15.0% ZEISS 25mm f/2 Batis in Lenses: Mirrorless
$1299 SAVE $200 = 13.0% ZEISS 21mm f/2.8 Loxia in Lenses: Mirrorless
$1999 SAVE $300 = 13.0% ZEISS 18mm f/2.8 Milvus ZF.2 in Lenses: DSLR

diglloyd Inc. | FTC Disclosure | PRIVACY POLICY | Trademarks | Terms of Use
Contact | About Lloyd Chambers | Consulting | Photo Tours
RSS Feeds | Twitter
Copyright © 2008-2017 diglloyd Inc, all rights reserved.