This page last changed on Apr 22, 2005 by mattlangston.

We have a simple backup utility to keep in sync two different nfs partitions.

For example, u12 (/nfs/farm/g/glast/u12) is duplicated on u16 (/nfs/farm/g/glast/u16).

Currently we run two shell scripts in a cron job, located on glast01. To change/fix any procedure follow these instructions:

1. ssh to glast01 and become glast user.
2. cd ~/rsync
3. There are two bash scripts one used for backing up u12 and the other for backing up u16. movelog.pl is a helper script that moves the rsync log file to a log directory when the job is finished and is used by the bash scripts. You generally do not change that file.
4. The bash scripts run one every midnight (u12 backup), and one every two hours (u14 backup).
5. Change cron jobs using 'crontab -e' if more or less time granularity is desired.
6. The logs of the backups are created in directories u12/pipeline/log/rsync_u12_to_u16
and u14/pipeline/log/rsync_u14_to_15.
7. Checking disk space 'df -k .' on both partitions should reveal same disk space on both partitions. We use special rsync flag --hard-links to properly copy hard links in order to not increase the size of the destination partition. See 'man rsync'for more details.
8. It is possible to backup only some of the subdirectories by editing the bash shell scripts in one place only.
9. I delete log files usually on a weekly basis. Will add it to the cron job if necessary.

4/22/05
Igor

Document generated by Confluence on Jan 21, 2010 11:37