gitbackup icon indicating copy to clipboard operation
gitbackup copied to clipboard
verified publisher icon super3

Deduplication

Open calebcase opened this issue 6 years ago • 2 comments

Forks of large repos can result in considerable wasted space due to duplicates.

Here are some related issues from gitlab and github attempting to deal with the duplication: https://gitlab.com/gitlab-org/gitlab-foss/issues/23029 https://gitlab.com/groups/gitlab-org/-/epics/189 https://github.blog/2015-09-22-counting-objects/

This related feature was merged to upstream git tooling: https://github.blog/2019-02-24-highlights-from-git-2-21/#delta-islands

Additionally GIT_COMMON_DIR may be useful in this situation.

We should test out different methods with the intention of making it easy to clone directly from storj and have it "just work" :tm:.

calebcase avatar Sep 26 '19 15:09 calebcase

@calebcase Do you have any idea which of these solutions could be the best?

montyanderson avatar Sep 27 '19 12:09 montyanderson

I think the most promising option is to use git alternates, but more experimentation needs to be done to confirm it will work.

calebcase avatar Sep 30 '19 16:09 calebcase