Restoring NOMAD Server from Backup

Overview

There are now two layers of backup for the NOMAD server:

1. A snapshot is taken of the whole VM every day. Snapshots from the past 30 days are recoverable by opening a ticket with ICT.
2. A cronjob runs a backup script every day that copies the contents of the mongo database and the raw data files to the ephemeral space on the RDS. These files are automatically deleted after 30 days.

Recovery of the whole VM

To restore the VM to a previous snapshot, open a ticket with ICT. They have a specific form for this.

Recovery of mongo DB and/or raw data files

Raw data files are backed up from /nomad/datastore to rds/aichemyrds/ephemeral as .tar.gz compressed files. To restore the data, you need to move the file from /mnt/aichemyrds/ephemeral to nomad, uncompress it then rename it to datastore.

The mongodb is backed up to rds/aichemyrds/ephemeral. There are instructions on the NOMAD docs on restoring the mongodb from a database dump.