Increment deduplications of file extents. Replaces the dedupe_extent of duperemove.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
Denis Knauf 4d72462ea0 version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 9 months ago
bin version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 9 months ago
ext/fideduperange version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 9 months ago
lib version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 9 months ago
.gitignore init 9 months ago
Gemfile version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 9 months ago
Gemfile.lock init 9 months ago
README.adoc version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 9 months ago
Rakefile version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 9 months ago
duperemoverb.gemspec version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 9 months ago

README.adoc

duperemove(rb)

Replaces duperemove`s dedupe-functionality. It is an own program, which uses the database like `duperemove. While duperemove scans directories and builds database, this program only dedupes files extents.

The advantage is, duperemoverb allowes incremental/partial deduplications. While duperemove deduplicates any files registered in database, you can give a path, which files to deduplicate. Files outside this path will be ignored, but will be deduplicated, if it shares same digests like extends of file inside this path.

Partial deduplication

  • /a/1 has two extents: 0x12, 0x54

  • /b/1 has two extents: 0x54, 0xa8

  • /b/2 has two extents: 0x90, 0xa8

If you call duperemoverb dedupe /a, /b/1 and /b/2 will be ignored, but the first extent of /b/1 will be deduplicated with /a/1 second extent.