deac/duperemoverb
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
Increment deduplications of file extents. Replaces the dedupe_extent of duperemove.
4 commits 1 branch 0 tags 41 KiB
Ruby 97.1%
C 2.9%
Find a file
Denis Knauf 4d72462ea0 version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange.
2021-09-06 19:46:15 +02:00
bin version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 2021-09-06 19:46:15 +02:00
ext/fideduperange version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 2021-09-06 19:46:15 +02:00
lib version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 2021-09-06 19:46:15 +02:00
.gitignore init 2021-09-02 23:19:47 +02:00
duperemoverb.gemspec version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 2021-09-06 19:46:15 +02:00
Gemfile version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 2021-09-06 19:46:15 +02:00
Gemfile.lock init 2021-09-02 23:19:47 +02:00
Rakefile version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 2021-09-06 19:46:15 +02:00
README.adoc version 0.0.3. deduperemoverb -> duperemoverb. extension named fideduperange. 2021-09-06 19:46:15 +02:00

README.adoc 

duperemove(rb)
==============

Replaces `duperemove`s dedupe-functionality.
It is an own program, which uses the database like `duperemove`.
While `duperemove` scans directories and builds database, this program only dedupes files extents.

The advantage is, duperemoverb allowes incremental/partial deduplications.
While duperemove deduplicates any files registered in database, you can give a path, which files to deduplicate.
Files outside this path will be ignored, but will be deduplicated, if it shares same digests like extends of file inside this path.

Partial deduplication
---------------------

* /a/1 has two extents: 0x12, 0x54
* /b/1 has two extents: 0x54, 0xa8
* /b/2 has two extents: 0x90, 0xa8

If you call `duperemoverb dedupe /a`, `/b/1` and `/b/2` will be ignored, but the first extent of `/b/1` will be deduplicated with `/a/1` second extent.