Backup
General
- https://wiki.archlinux.org/index.php/Backup_Programs
- http://askubuntu.com/questions/2596/comparison-of-backup-tools
- http://www.basicallytech.com/blog/index.php?/archives/73-Using-a-USB-external-hard-disk-for-backups-with-Linux.html
- http://www.halfgaar.net/backing-up-unix
- http://etbe.coker.com.au/2012/08/08/hard-drives-backup/
Specific
"Delta based incrementals make sense for tape drives. You run a full backup once, then incremental deltas for every day. When enough time has passed since the full backup, you do a new full backup, and then future incrementals are based on that. Repeat forever."
Rsync
- http://en.wikipedia.org/wiki/Rsync
- https://wiki.archlinux.org/index.php/Full_System_Backup_with_rsync
rsync -aAXv /* /path/to/backup/folder --exclude={/dev/*,/proc/*,/sys/*,/tmp/*,/run/*,/mnt/*,/media/*,/lost+found,/home/*/.gvfs} arch based, untested
GUI
Systems
- Arno's SmartBackup Script - 'intelligent' version of rsync
- Ars Technica Forums: The state of opensource backups
rdiff-backup
- rdiff-backup backs up one directory to another, possibly over a network. The target directory ends up a copy of the source directory, but extra reverse diffs are stored in a special subdirectory of that target directory, so you can still recover files lost some time ago. The idea is to combine the best features of a mirror and an incremental backup. rdiff-backup also preserves subdirectories, hard links, dev files, permissions, uid/gid ownership, modification times, extended attributes, acls, and resource forks. Also, rdiff-backup can operate in a bandwidth efficient manner over a pipe, like rsync. Thus you can use rdiff-backup and ssh to securely back a hard drive up to a remote location, and only the differences will be transmitted. Finally, rdiff-backup is easy to use and settings have sensical defaults.
- man, readme, examples, wiki
- sync and rdiff-backup do not share any code, but rdiff-backup uses the rsync algorithm
- http://wiki.rdiff-backup.org/wiki/index.php/Main_Page
- http://www.saltycrane.com/blog/2008/02/backup-on-linux-rsnapshot-vs-rdiff/
- http://www.paulocabido.com/linux/rsnapshot-vs-rdiff-backup/
- rdiffWeb is a web interface for browsing and restoring from rdiff-backup repositories. It is written in Python and is distributed under the GPL license.
rsnapshot
- rsnapshot - Local filesystem snapshots are handled with rsync. Secure remote connections are handled with rsync over ssh, while anonymous rsync connections simply use an rsync server. Both remote and local transfers depend on rsync. rsnapshot saves much more disk space than you might imagine. The amount of space required is roughly the size of one full backup, plus a copy of each additional file that is changed. rsnapshot makes extensive use of hard links, so if the file doesn't change, the next snapshot is simply a hard link to the exact same file.
rbackup
Duplicity
- Duplicity backs directories by producing encrypted tar-format volumes and uploading them to a remote or local file server. Because duplicity uses librsync, the incremental archives are space efficient and only record the parts of files that have changed since the last backup. Because duplicity uses GnuPG to encrypt and/or sign these archives, they will be safe from spying and/or modification by the server.
duply (simple duplicity)
Duplicati
- http://www.duplicati.com/
- http://en.wikipedia.org/wiki/Duplicati_(software)
- C#
- not that CLI ready?
Areca Backup
- Areca Backup is a personal file backup software developed in Java.
- http://en.wikipedia.org/wiki/Areca_Backup
- zip/zip64 only
- slow?
- No deduplication
BackupPC
- BackupPC is a high-performance, enterprise-grade system for backing up Linux and WinXX PCs and laptops to a server's disk. BackupPC is highly configurable and easy to install and maintain. Given the ever decreasing cost of disks and raid systems, it is now practical and cost effective to backup a large number of machines onto a server's local disk or network storage. This is what BackupPC does. For some sites, this might be the complete backup solution. For other sites, additional permanent archives could be created by periodically backing up the server to tape. A variety of Open Source systems are available for doing backup to tape. BackupPC is written in Perl and extracts backup data via SMB using Samba, tar over ssh/rsh/nfs, or rsync. It is robust, reliable, well documented and freely available as Open Source on SourceForge.
- https://wiki.archlinux.org/index.php/BackupPC
- http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=Main_Page
- http://wiki.zmanda.com/index.php/Backuppc
- Supports NFS, SSH, SMB and rsync
- Perl with web interface
- Deduplication via hardlinks
- Slooow?
- https://github.com/Zloy/backuppc_on_nginx
- http://www.homershut.net/wiki/BackupPC%20with%20nginx
- http://monklinux.blogspot.co.uk/2012/02/installing-backuppc-on-gentoo-linux.html
AMANDA
- AMANDA, the Advanced Maryland Automatic Network Disk Archiver, is a backup solution that allows the IT administrator to set up a single master backup server to back up multiple hosts over network to tape drives/changers or disks or optical media. Amanda uses native utilities and formats (e.g. dump and/or GNU tar) and can back up a large number of servers and workstations running multiple versions of Linux or Unix. Amanda uses a native Windows client to back up Microsoft Windows desktops and servers.
"the Amanda planner runs on the server to decide exactly how to go about backing things up. It, too, contacts each Amanda client and requests an estimate of the size of full and incremental dumps for each DLE. It then does some complex planning based on the history of each DLE, the estimated sizes, the available storage space, and a number of tweakable parameters to decide what to back up. This often confuses newcomers, who have control issues and want to tell Amanda when to do full backups and when to do incrementals. The planner is one of Amanda's strengths! Don't fight it!"
Bacula
- http://en.wikipedia.org/wiki/Bacula
- unique backup format
- config over inc/diff/full 'interesting'
- no web interface?
- "a beast to get up and running. But it is lighting fast"
- http://monklinux.blogspot.co.uk/2012/02/conclusions-regarding-amanda-backup.html
Backup Ninja
- Backupninja allows you to coordinate system backup by dropping a few simple configuration files into /etc/backup.d/. Most programs you might use for making backups don't have their own configuration file format. Backupninja provides a centralized way to configure and schedule many different backup utilities. It allows for secure, remote, incremental filesytem backup (via rdiff-backup), compressed incremental data, backup system and hardware info, encrypted remote backups (via duplicity), safe backup of MySQL/PostgreSQL databases, subversion or trac repositories, burn CD/DVDs or create ISOs, incremental rsync with hardlinking.
DAR
- Disk ARchive is a shell command that backs up directory trees and files, taking care of hard links, Extended Attributes, sparse files, MacOS's file forks, any inode type (including Solaris Door inodes), etc.
backup2l
- backup2l - low-maintenance backup/restore tool. backup2l is a lightweight command line tool for generating, maintaining and restoring backups on a mountable file system (e. g. hard disk). The main design goals are are low maintenance effort, efficiency, transparency and robustness. In a default installation, backups are created autonomously by a cron script. supports hierarchical differential backups with a user-specified number of levels and backups per level. With this scheme, the total number of archives that have to be stored only increases logarithmically with the number of differential backups since the last full backup. Hence, small incremental backups can be generated at short intervals while time- and space-consuming full backups are only sparsely needed.
Obnam
- Obnam is an easy, secure backup program. Snapshot backups. Every generation looks like a complete snapshot, so you don't need to care about full versus incremental backups, or rotate real or virtual tapes. Data de-duplication, across files, and backup generations. If the backup repository already contains a particular chunk of data, it will be re-used, even if it was in another file in an older backup generation. This way, you don't need to worry about moving around large files, or modifying them. Encrypted backups, using GnuPG.
- http://blog.liw.fi/posts/obnam-1.0/
- sounds well thought out, slow with sftp?
- no web interface
- unique format
- author suffers from NIH ;)
Box Backup
urbackup
File and image backups are made while the system is running without interrupting current processes. UrBackup also continously watches folders you want backed up, in oder to quickly find differences to previous backups. Thus incremental file backups are really fast. Your files can be restored through the web interface or the Windows Explorer while the backups of drive volumes can be restored with a bootable CD or USB-Stick (bare metal restore).
Btrfs
See also *nix#Btrfs.
Btrfs does copy-on-write, like hardlinks at the block level(?)
No mature wrapper system using it yet.
- Using btrfs snapshots for incremental backup - Feb 1, 2010
- Do-It-Yourself Backup System Using Rsync and Btrfs - April 6th, 2011
- migrate rsnapshot-based backup to btrfs-snapshots - 23 Okt, 2011
- serverfault: btrfs-enabled backup solution - Feb 3, 2012
- btrfs max number of hardlinks gotcha 28th May 2012, sorted
- btrfs-backup - ruby, 8 months ago
- btr-backup - ruby/bash, 7 months ago
- btrbackup - bash, 3 months ago
- rsyncbtrfs - bash, 11 months ago
- clairvoyant backup - v2.3, aug 2010