Distribute and manage files with git-annex
Data Warehouse

© Lead Image © adimas, Fotolia.com
Git-annex is storage software that distributes files across devices, servers, and cloud services. It can encrypt files and keep everything in sync, and it always knows where to find your data.
If you move into a secluded cabin, you cannot expect a broadband Internet connection. When US Debian developer Joey Hess moved to such a place in 2010, he had to find a way to reconcile his work with his new habitat. He only launched his expensive dial-up connection once a week for cost reasons, but he had a whole bunch of servers with a stack of hard drives to synchronize.
Crowdfunding Success
Because of his situation, Hess began to write a synchronization tool for his own purposes that is now used as the underpinnings for the free Git version control software. This tool is now widely available under the GPL as git-annex [1]. Additionally, thanks to a crowdfunding campaign, Hess has also developed the git-annex assistant
web GUI, which makes the software more accessible for end users. See the "Installation" box for more information.
On the git-annex homepage, Hess describes two target groups for the software: Bob the archivist and Alice the globetrotter. The archivist can use git-annex to manage myriad files in a single directory tree, even though the files are spread across multiple servers and even across removable hard drives. For safety reasons, git-annex can also create multiple copies of each file.
[...]
Buy this article as PDF
(incl. VAT)
Buy Linux Magazine
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters
Support Our Work
Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.

News
-
OpenMandriva Lx 6.0 Available for Installation
The latest release of OpenMandriva has arrived with a new kernel, an updated Plasma desktop, and a server edition.
-
TrueNAS 25.04 Arrives with Thousands of Changes
One of the most popular Linux-based NAS solutions has rolled out the latest edition, based on Ubuntu 25.04.
-
Fedora 42 Available with Two New Spins
The latest release from the Fedora Project includes the usual updates, a new kernel, an official KDE Plasma spin, and a new System76 spin.
-
So Long, ArcoLinux
The ArcoLinux distribution is the latest Linux distribution to shut down.
-
What Open Source Pros Look for in a Job Role
Learn what professionals in technical and non-technical roles say is most important when seeking a new position.
-
Asahi Linux Runs into Issues with M4 Support
Due to Apple Silicon changes, the Asahi Linux project is at odds with adding support for the M4 chips.
-
Plasma 6.3.4 Now Available
Although not a major release, Plasma 6.3.4 does fix some bugs and offer a subtle change for the Plasma sidebar.
-
Linux Kernel 6.15 First Release Candidate Now Available
Linux Torvalds has announced that the release candidate for the final release of the Linux 6.15 series is now available.
-
Akamai Will Host kernel.org
The organization dedicated to cloud-based solutions has agreed to host kernel.org to deliver long-term stability for the development team.
-
Linux Kernel 6.14 Released
The latest Linux kernel has arrived with extra Rust support and more.